Bangalore, Karnataka, India
Information Technology
Full-Time
Accenture in India
Overview
Job Title - Lead Data Engineer Specialist ACS SONG
Management Level: Level 9 Specialist
Location: Kochi, Coimbatore, Trivandrum
Must have skills: Databricks including Spark-based ETL, Delta Lake
Good to have skills: Pyspark
Job Summary
We are seeking a highly skilled and experienced Senior Data Engineer to join our growing Data and Analytics team. The ideal candidate will have deep expertise in Databricks and cloud data warehousing, with a proven track record of designing and building scalable data pipelines, optimizing data architectures, and enabling robust analytics capabilities. This role involves working collaboratively with cross-functional teams to ensure the organization leverages data as a strategic asset. Your responsibilities will include:
Roles And Responsibilities
Management Level: Level 9 Specialist
Location: Kochi, Coimbatore, Trivandrum
Must have skills: Databricks including Spark-based ETL, Delta Lake
Good to have skills: Pyspark
Job Summary
We are seeking a highly skilled and experienced Senior Data Engineer to join our growing Data and Analytics team. The ideal candidate will have deep expertise in Databricks and cloud data warehousing, with a proven track record of designing and building scalable data pipelines, optimizing data architectures, and enabling robust analytics capabilities. This role involves working collaboratively with cross-functional teams to ensure the organization leverages data as a strategic asset. Your responsibilities will include:
Roles And Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes using Databricks and other modern tools.
- Architect, implement, and manage cloud-based data warehousing solutions on Databricks (Lakehouse Architecture)
- Develop and maintain optimized data lake architectures to support advanced analytics and machine learning use cases.
- Collaborate with stakeholders to gather requirements, design solutions, and ensure high-quality data delivery.
- Optimize data pipelines for performance and cost efficiency.
- Implement and enforce best practices for data governance, access control, security, and compliance in the cloud.
- Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
- Lead and mentor junior engineers, fostering a culture of continuous learning and innovation.
- Excellent communication skills
- Ability to work independently and along with client based out of western Europe.
- 5-8 years of experience in data engineering roles with a focus on cloud platforms.
- Proficiency in Databricks, including Spark-based ETL, Delta Lake, and SQL.
- Strong experience with one or more cloud platforms (AWS preferred).
- Experience in Snowflakes and Azure SQL will be an added advantage
- Hands on experience with Delta Lake, Unity Catalog, and Lakehouse architecture concepts
- Strong programming skills in Python and SQL; experience with Pyspark a plus.
- Solid understanding of data modeling concepts and practices (e.g., star schema, dimensional modeling).
- Knowledge of CI/CD practices and version control systems (e.g., Git).
- Familiarity with data governance and security practices, including GDPR and CCPA compliance.
- Experience with Airflow or similar workflow orchestration tools.
- Exposure to machine learning workflows and MLOps.
- Certification in Databricks, AWS
- Familiarity with data visualization tools such as Power BI
Similar Jobs
View All
1 Hour ago
Software Developer - SDE1 Backend
Information Technology
- 2 - 4 Yrs
- Mumbai
Key Responsibilities:
● Design, develop, and maintain software applications using Golang, Node.js and PHP.
● Create and optimize database schemas and queries using MySQL and MongoDB.
● Implement caching solutions with Redis.
● Integra...
2 Hours ago
Cybersecurity Engineer
Information Technology
- 2 - 8 Yrs
- Anywhere in India/Multiple Locations
Key Responsibilities:
Design, implement, and manage Palo Alto Networks solutions, including:
Next-Gen Firewall (NGFW)
EDR/XDR (Cortex XDR)
SIEM/SOAR (Cortex XSIAM)
Lead and support migration projects from legacy platforms (e.g., Splunk,...
2 Hours ago
Application Developer
Information Technology
- 1 - 5 Yrs
- Anywhere in India/Multiple Locations
Project Role :Application Developer
Must have skills :.Net Full Stack Development
Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processe...
1 Day ago
SAP Finance Director
Finance & Banking
- 5500000 - 6000000 INR - Yearly
- 18 - 21 Yrs
- Mumbai, Bangalore, Hyderabad, Pune
Responsibility
You are a key player in large S/4HANA transformation programmes for global customers (team size of 50+ people)
You have more than 15 years of experience in SAP either in value stream leadership, business, or domain expert
You...
1 Day ago
DevOps Engineer
Information Technology
- Bangalore, Karnataka, India
DescriptionTo deliver and maintain IT-applications and –services in order to realize the strategy in the field of information technology. Engineers in this job category work in an agile way, in squads to deliver short-cycle full-fledged IT products....
1 Day ago
ChicMic Studios - Android Developer - Kotlin
Information Technology
- Gurugram, Haryana, India
Job DescriptionKey Responsibilities : Design and build advanced applications for the Android platform using Kotlin. Collaborate with cross-functional teams to define, design, and ship new features. Work with outside data sources and APIs (REST, J...
1 Day ago
Optimum Info - AWS Cloud Infrastructure Engineer
Information Technology
- Gurugram, Haryana, India
Job DescriptionAt Optimum Info, we are continually innovating and developing a range of software solutions empowering the Network Development and Field Operations businesses at Automotive, Power Sports and Equipment industries. Our integrated suite ...
1 Day ago
Azure Cloud Architect
Information Technology
- Gurugram, Haryana, India
Job DescriptionJob Title: Azure Cloud ArchitectAbout the Company/TeamOracle FSGIU's Finergy division is a specialized team dedicated to transforming the Banking, Financial Services, and Insurance (BFSI) industry through innovative technology solutio...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in