Free cookie consent management tool by TermsFeed Senior Data Engineer - ETL | Antal Tech Jobs
Back to Jobs
2 Days ago

Senior Data Engineer - ETL

decor
Aurangabad, Maharashtra, India
Information Technology
Full-Time
Cynosure Corporate Solutions

Overview

Key Responsibilities

  • Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  • Build scalable and automated MLOps pipelines for model training, validation, and deployment using AWS SageMaker and related services.
  • Implement and manage Infrastructure as Code (IaC) using Terraform for AWS provisioning and maintenance.
  • Collaborate with ML, Data Science, and DevOps teams to ensure reliable and efficient model deployment workflows.
  • Optimize data storage and retrieval strategies for both structured and unstructured large-scale datasets.
  • Integrate and transform data from multiple sources into data lakes and data warehouses.
  • Monitor, troubleshoot, and improve performance of cloud-native data systems in a fast-paced production setup.
  • Ensure compliance with data governance, privacy, and security standards across all data operations.
  • Document data engineering workflows and architectural decisions for transparency and maintainability.

Requirements

  • 5+ Years of experience as Data Engineer or in similar role.
  • Proven experience in building data pipelines and streaming applications using Apache Kafka and Apache Flink.
  • Strong ETL development skills, with deep understanding of data modeling and data architecture in large-scale environments.
  • Hands-on experience with AWS services, including SageMaker, S3, Glue, Lambda, and CloudFormation or Terraform.
  • Proficiency in Python and SQL; knowledge of Java is a plus, especially for streaming use cases.
  • Strong grasp of MLOps best practices, including model versioning, monitoring, and CI/CD for ML pipelines.
  • Deep knowledge of IaC tools, particularly Terraform, for automating cloud infrastructure.
  • Excellent analytical and problem-solving abilities, especially with regard to data processing and deployment issues.
  • Agile mindset with experience working in fast-paced, iterative development environments.
  • Strong communication and team collaboration skills.

(ref:hirist.tech)
Share job
Similar Jobs
View All
1 Day ago
Test Engineer
Information Technology
  • Hyderabad, Telangana, India
You'll be part of global teams across Bupa markets You'll get to work on building innovative digital health solutions About Our ClientBupa is a leading international healthcare company, established in 1947. You may know us as Niva Bupa in India, ...
decor
1 Day ago
Risk Consulting - Digital Risk - Senior - AI Engineer
Information Technology
  • Aurangabad, Maharashtra, India
Job DescriptionAt EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help to build a better working world.Job T...
decor
1 Day ago
Java Fullstack Developer
Information Technology
  • Hyderabad, Telangana, India
Experience: 7-13Essential Functions 10+ years of professional experience in full stack software development. Knowledge of version control systems like Git and development workflows (CI/CD). Strong understanding of cloud security, scalability, and pe...
decor
1 Day ago
Business Analyst, Application Support - WBITVP
Information Technology
  • Hyderabad, Telangana, India
Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s v...
decor
1 Day ago
Software Engineer - PHP/WordPress Developer
Information Technology
  • Bangalore, Karnataka, India
Current Openings Software Engineer - PHP/WordPress Developer Software Engineer - PHP/WordPress DeveloperExperience : 0 - 2 yearsBhubaneswar, Delhi - NCR, Remote WorkingApplyAbout The JobFeaturedWe are seeking a passionate and motivated Junior PHP ...
decor
1 Day ago
Software Engineer III- Splunk, Linux
Information Technology
  • Hyderabad, Telangana, India
Job DescriptionWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Employee Platforms team, you serve as a seasoned member of an agi...
decor
2 Days ago
Senior Machine Learning Engineer
Information Technology
  • 4500000 - 4500000 INR - Yearly
  • Aurangabad, Maharashtra, India
Experience: 5.00 + yearsSalary: INR 4500000.00 / year (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Full Time Indefinite Contract(40 hrs a week/160 hrs a month)(*Note...
decor
2 Days ago
Python Developer
Information Technology
  • 888888 - 977772 INR - Yearly
  • Bangalore, Karnataka, India
Experience: 2.00 + yearsSalary: INR 74074-81481 / month (based on experience)Expected Notice Period: 30 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Part Time Contract for 12 Months (20 hrs a week/80 hrs a month)(...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media