Free cookie consent management tool by TermsFeed Lead Data Engineer | Antal Tech Jobs
Back to Jobs
1 Week ago

Lead Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
USEReady

Overview

Job Summary

We are looking for an experienced Lead Data Engineer to drive data engineering initiatives, architect scalable data solutions, and lead a team of engineers. The ideal candidate will have 10+ years of experience, specializing in Snowflake,Microsoft Fabric, Matillion, and Cloud platforms (Azure/AWS) and expertise in BI tools like Power BI, Tableau. This role requires strong SQL skills, analytical capabilities, excellent communication, and leadership abilities. The candidate should be able to scope projects, interact with clients, and deliver efficient data solutions.

Key Responsibilities

  • Data Architecture & Engineering: Design and develop scalable, high-performance data solutions using Snowflake, Microsoft Fabric, Matillion, and cloud environments (Azure/AWS).
  • ETL/ELT Development: Build and optimize ETL/ELT pipelines leveraging Matillion, Snowflake native capabilities, dbt, and other data integration tools.
  • BI & Data Visualization: Use Power BI, Tableau, and DOMO to develop insightful reports and dashboards, ensuring seamless data flow from the backend to visualization layers.
  • SQL Development & Optimization: Write and optimize complex SQL queries for performance tuning, data transformation, and analytics.
  • Cloud Data Management: Implement data lakes, data warehouses, and data marts on Azure/AWS, ensuring security, scalability, and cost efficiency.
  • Data Modeling & Data Warehousing: Design and implement dimensional models, star/snowflake schemas, and data warehouse best practices.
  • Project Scoping & Client Engagement: Collaborate with stakeholders to understand business requirements, define project scope, and deliver tailored data solutions.
  • Team Leadership: Lead a team of data engineers, conduct code reviews, mentor junior engineers, and establish best practices.
  • Automation & Performance Optimization: Automate workflows, monitor system performance, and optimize data processes for efficiency.
  • Data Governance & Security: Ensure compliance with industry best practices, data privacy laws, and security protocols.
  • Workflow Orchestration: Implement and manage orchestration tools like Apache Airflow, Prefect, or Dagster for automated data workflows.

Required Skills & Qualifications

  • 10+ years of experience in data engineering and cloud-based data solutions.
  • Expertise in Snowflake, including performance tuning, data sharing, and security management.
  • Strong experience with Matillion for ETL/ELT development.
  • Proficiency in Azure or AWS Cloud Services (e.g., AWS Redshift, S3, Glue, Azure Synapse, Data Factory).
  • Hands-on experience with BI tools such as Power BI, Tableau.
  • Exceptional SQL skills for query optimization and data modeling.
  • Strong analytical and problem-solving skills to translate business needs into technical solutions.
  • Proven ability to lead teams, mentor engineers, and manage projects effectively.
  • Excellent communication skills to collaborate with clients, stakeholders, and cross-functional teams.
  • Experience with Python or other scripting languages for data processing is a plus.
  • Experience with dbt for data transformation and modeling.
  • Knowledge of workflow orchestration tools like Apache Airflow, Prefect, or Dagster.
Share job
Similar Jobs
View All
11 Hours ago
Program Manager
Information Technology
  • 15 - 18 Yrs
  • Gurgaon / Gurugram
We’re Hiring | Program Manager Location: Gurugram, India Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
decor
12 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
  • 50,00,000 - 60,00,000 INR - Annual
  • 12 - 18 Yrs
  • Hyderabad
About the Role: We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
decor
12 Hours ago
Principal Engineer - Fullstack
Information Technology
  • 30,00,000 - 40,00,000 INR - Annual
  • 8 - 12 Yrs
  • Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
decor
12 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
  • 4,00,000 - 8,00,000 INR - Yearly
  • 4 - 8 Yrs
  • West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
decor
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
  • 1 - 1 Yrs
  • Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
  • 1 - 1 Yrs
  • Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Solution Architect – Databricks
Information Technology
  • 40,00,000 - 50,00,000 INR - Annual
  • 9 - 15 Yrs
  • Mumbai
Summary role description: Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML. Company description: Our client is a US-headquarte...
decor
1 Day ago
Interesting Job Opportunity: Utilli - Full Stack Developer - Node.js/React.js
Information Technology
  • Bangalore, Karnataka, India
Job SummaryWe are seeking a highly skilled Full Stack Engineer to lead a team of developers in building and maintaining scalable web applications. This role requires a hands-on leader with deep expertise in JavaScript frameworks and modern developme...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media