Free cookie consent management tool by TermsFeed Data Lake Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Lake Engineer

decor
Chennai, Tamil Nadu, India
Information Technology
Full-Time
Kimbal

Overview



Role Overview

We are looking for a skilled Data Lake Engineer to design, build, and maintain scalable, secure, and high-performance data lake platforms that enable analytics, reporting, and data-driven decision-making. The role involves building robust data pipelines, optimizing storage and processing, and ensuring data reliability, governance, and cost efficiency.

Key Responsibilities

  • Design and implement scalable Data Lake architecture for structured, semi-structured, and unstructured data
  • Build and maintain reliable ETL/ELT pipelines for batch and real-time ingestion
  • Optimize data storage, partitioning, and performance for analytics workloads
  • Implement data quality, validation, and governance standards
  • Collaborate with Data Engineering, Analytics, Product, and DevOps teams
  • Enable self-service analytics through curated datasets and reusable components
  • Monitor system performance, reliability, and cost optimization
  • Automate deployments and workflows using CI/CD and Infrastructure as Code
  • Ensure security, compliance, and access controls across the platform
  • Troubleshoot data issues and drive continuous improvements

Required Skills

  • Strong experience with Python/Scala/SQL
  • Hands-on experience with Data Lake technologies (e.g., object storage, distributed compute engines)
  • Experience building ETL/ELT pipelines and orchestration frameworks
  • Knowledge of data modeling and schema design
  • Familiarity with APIs, microservices, and streaming concepts
  • Understanding of performance tuning and cost optimization
  • Strong problem-solving and system design skills

Good to Have

  • Experience with real-time/streaming pipelines
  • Exposure to DevOps/CloudOps practices
  • Data governance and metadata management knowledge
  • Observability/monitoring tools experience
  • Domain knowledge in analytics/reporting platforms

Experience

  • 3–5 years (Engineer)
  • 6–10+ years (Senior/Architect)

Behavioral Expectations

  • Ownership mindset with end-to-end accountability
  • Quality-first approach (first-time-right delivery)
  • Strong collaboration across teams
  • Customer-centric thinking
  • Focus on reliability, scalability, and cost efficiency
Share job
Similar Jobs
View All
14 Minutes ago
AI Engineer/Architect
AI & Machine Learning Advancement
  • 5 - 8 Yrs
  • Anywhere in India/Multiple Locations
Role Overview We are seeking an experienced AI Architect to design and govern end‑to‑end AI and ML architectures across a variety of enterprise use cases (e.g., prediction, personalization, recommendation, anomaly detection, automation). The ideal c...
decor
1 Day ago
Software Engineer, Cloud - Sustaining Engineering
Information Technology
  • Chennai, Tamil Nadu, India
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, en...
decor
1 Day ago
ALLEN Overseas - Business Analyst
Information Technology
  • Chennai, Tamil Nadu, India
Job Description : Business Analyst - Business & Operations (Middle East)Position DetailsJob Title : Business Analyst - Business & Operations (Middle East)Reports To : Head - Business & OperationsLocation : Dubai (with occasional travel to India and o...
decor
1 Day ago
Data Engineer + Python + Pyspark + SQL + AWS
Information Technology
  • Chennai, Tamil Nadu, India
Position DescriptionFounded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from s...
decor
1 Day ago
Technical Specialist - Python Developer
Information Technology
  • Chennai, Tamil Nadu, India
Job DescriptionTitle: Senior Python DeveloperLocation: Hyderabad/Mumbai/BengaluruExp Level: 8+Education: Any DegreeKey Responsibilities:Design, develop, and maintain scalable, secure, and high-performance applications using Python, PHP, and JavaScrip...
decor
1 Day ago
Senior Software Engineer
Information Technology
  • Chennai, Tamil Nadu, India
Are you excited by the idea of joining a high-quality, talented team within a game-changing FinTech company?Do you want to tackle major problems in the consumer credit industry with a socially-responsible solution? If so, we'd love to hear from you!A...
decor
1 Day ago
Lead Software Engineer
Information Technology
  • Chennai, Tamil Nadu, India
🚀 Hiring: Lead – Software Engineer (Python/Django)📍 Location: Pune onsite💼 Experience: 5-6+ Years🔎 About the RoleWe are seeking an experienced Lead – Software Engineer to drive the design, development, and scalability of high-performance web applicat...
decor
1 Day ago
Senior Python Developer
Information Technology
  • Chennai, Tamil Nadu, India
OverviewCACTUS is a remote-first organization and we embrace an accelerate from anywhere culture. You may be required to travel to our Mumbai office based on business requirements or for company/team events.You will be a part of Cactus Labs which is ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media