Nashik, Maharashtra, India
Information Technology
Full-Time
UST
Overview
Role Description
We are seeking a skilled Data Engineer with strong expertise in Python, PySpark, and the AWS Data Engineering stack to design, develop, and optimize large-scale ETL pipelines. The ideal candidate will have a solid foundation in data engineering best practices, automation, and modern cloud-based architectures, along with a passion for leveraging Generative AI tools to boost productivity and code quality.
Core Must-Have Skills
Python ,Pyspark,Data Validation,Transformation Logic
We are seeking a skilled Data Engineer with strong expertise in Python, PySpark, and the AWS Data Engineering stack to design, develop, and optimize large-scale ETL pipelines. The ideal candidate will have a solid foundation in data engineering best practices, automation, and modern cloud-based architectures, along with a passion for leveraging Generative AI tools to boost productivity and code quality.
Core Must-Have Skills
- Strong proficiency in Python and PySpark for developing and optimizing ETL pipelines.
- In-depth understanding of data engineering best practices, including data validation, transformation logic, and performance optimization.
- Experience working with large-scale data processing and distributed computing environments.
- Working knowledge of Scala programming, particularly for Spark-based use cases.
- Familiarity with AI-assisted development tools such as GitHub Copilot to enhance productivity and code quality.
- Hands-on experience with AWS Glue, Lambda Functions, EventBridge, SQS, SNS, DynamoDB, and Streams for building serverless and event-driven data pipelines.
- Proficiency in CloudWatch for creating dashboards, setting up s, and monitoring pipeline health.
- Basic working knowledge of AWS CDK and CloudFormation for infrastructure automation and deployment.
Python ,Pyspark,Data Validation,Transformation Logic
Similar Jobs
View All
15 Hours ago
Principal Architect - DotNet
Healthcare & Life Sciences
- 15 - 20 Yrs
- Chennai, Hyderabad
Summary role description:
Hiring Principal Architect – .NET Full Stack in the Healthcare Technology provider.
Company description:
Our client is a global technology and services provider with operations across the U.S. a...
15 Hours ago
Principal Architect - JAVA
Healthcare & Life Sciences
- 14 - 20 Yrs
Hiring for the Principal Architect - Java Full Stack for a healthcare technology leader advancing U.S. healthcare through AI and cloud innovation.
Company description:
Our client is a leading healthcare technology and clinical services ...
16 Hours ago
Full Stack Developer
Information Technology
- 5 - 8 Yrs
- Thane
About the Role
We are building advanced AI-powered enterprise products and are looking for a Node.js + UI Developer (React) to join our engineering team. This role involves end-to-end development of high-performance web applications, from backend ...
1 Day ago
Sr Technical Consultant
Information Technology
- 7 - 23 INR - Annual
- 5 - 8 Yrs
- Pune
Position: Sr. Technical Consultant (Dotnet 6.0+) Experience:
5+ Years
Job Title: ASP.NET Core 6.0 / Full stack Developer for Pune Location
We are looking for a seasoned ASP.NET Core 6.0 / MVC Developer to join our innovative team. This
ro...
1 Day ago
Mobile Engineer (React Native)
Information Technology
- 1200000 - 1800000 INR - Annual
- 3 - 6 Yrs
- Chennai
Job Description
About the Role
We are looking for a React Native Engineer to join our team in building robust, scalable, and high-performance mobile applications. You will work closely with engineers, designers, and product managers to deliver se...
1 Day ago
Senior AI/ML Engineer
Information Technology
- 2000000 - 2500000 INR - Annual
- 4 - 8 Yrs
- Chennai, Hyderabad
Role : Senior AI/ML Engineer
Experience : 4 - 8 years
Location: Chennai/Hyderabad
Work Mode: WFO
Roles & Responsibilities:
Design, implement, and deploy Machine Learning solutions to solve complex problems and deliver real busine...
1 Day ago
Junior Automation Tester - Selenium/Cypress
Information Technology
- Chennai, Tamil Nadu, India
DescriptionWe are seeking a motivated and enthusiastic Junior Automation Tester to join our Quality Assurance (QA) team.This role is ideal for recent graduates or those early in their career who have a foundational understanding of testing principle...
1 Day ago
Senior AI/Cloud Engineer
Information Technology
- Chennai, Tamil Nadu, India
Job DescriptionTechnical Expertise Experience: 5+ years of hands-on experience in cloud infrastructure engineering. IaC: Expert-level experience in writing and managing Terraform scripts/modules. Automation: Proficient in scripting with Python and B...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in