500000 - 1300000 INR - Yearly
Mumbai, Maharashtra, India
Information Technology
Full-Time
Deqode
Overview
Profile: AWS Data Engineer
Mandate skills :AWS + Databricks + Pyspark + SQL role
Location: Bangalore/Pune/Hyderabad/Chennai/Gurgaon:
Notice Period: Immediate
Key Requirements
Mandate skills :AWS + Databricks + Pyspark + SQL role
Location: Bangalore/Pune/Hyderabad/Chennai/Gurgaon:
Notice Period: Immediate
Key Requirements
- Design, build, and maintain scalable data pipelines to collect, process, and store from multiple datasets.
- Optimize data storage solutions for better performance, scalability, and cost-efficiency.
- Develop and manage ETL/ELT processes to transform data as per schema definitions, apply slicing and dicing, and make it available for downstream jobs and other teams.
- Collaborate closely with cross-functional teams to understand system and product functionalities, pace up feature development, and capture evolving data requirements.
- Engage with stakeholders to gather requirements and create curated datasets for downstream consumption and end-user reporting.
- Automate deployment and CI/CD processes using GitHub workflows, identifying areas to reduce manual, repetitive work.
- Ensure compliance with data governance policies, privacy regulations, and security protocols.
- Utilize cloud platforms like AWS and work on Databricks for data processing with S3 Storage.
- Work with distributed systems and big data technologies such as Spark, SQL, and Delta Lake.
- Integrate with SFTP to push data securely from Databricks to remote locations.
- Analyze and interpret spark query execution plans to fine-tune queries for faster and more efficient processing.
- Strong problem-solving and troubleshooting skills in large-scale distributed systems.
Similar Jobs
View All
1 Day ago
SDE 2 Backend
Finance & Banking
- 1800000 - 2200000 INR - Annual
- 2 - 4 Yrs
- Bangalore
Key Responsibilities
Design, develop, and maintain robust microservices in GoLang, with clean abstractions, high reliability, and readiness for scale.
Mentor junior engineers, review code, and help maintain a high bar for technical excellence...
1 Day ago
IOS Developer
Fintech
- 3 - 8 Yrs
- Mumbai
Job Description: iOS Developer
Industry: Insurance
Location: On-site
Role Overview
As an iOS Developer , you will be responsible for designing,
developing, and optimizing robust, high-quality iOS applications that drive our insurance
products...
1 Day ago
Senior Automation Systems Engineer
Internet
- 2500000 - 2600000 INR - Annual
- 6 - 8 Yrs
- Hyderabad
Job Description:
Key Responsibilities:
• Design, develop, and maintain robust automation frameworks and scripts primarily using Python.
• Lead efforts to automate testing processes (functional, regression, performance) and deployment pi...
1 Day ago
Junior Software Developer - Fresher
Information Technology
- 200000 - 240000 INR - Yearly
- Mumbai, Maharashtra, India
About the job:Key responsibilities: 1. Design, develop, and maintain applications using ReactJS, HTML, CSS, and JavaScript 2. Write clean, efficient, and maintainable code following coding standards. 3. Implement backend logic using Python and integ...
1 Day ago
Business Analyst, Infor ERP LN
Information Technology
- Mumbai, Maharashtra, India
Flex is the diversified manufacturing partner of choice that helps market-leading brands design, build and deliver innovative products that improve the world. We believe in the power of diversity and inclusion and cultivate a workplace culture of be...
1 Day ago
Assistant Manager_GCP DevOps Engineer_Pune
Information Technology
- Mumbai, Maharashtra, India
About VOISVOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value and enhancing quality and efficiency across 28 countries, and operating from 7 locations: Albania, Egypt, Hungary, India, Romania, Spain and the...
1 Day ago
Propulsion-System Architect
Information Technology
- Mumbai, Maharashtra, India
Key Responsibilities: Derive control strategies for the Vehicle Control Unit (VCU), with a focus on Torque Management and Energy Management. Translate customer needs and market trends into technical specifications for Chassis features. Engage with O...
1 Day ago
Entytle - Full Stack Developer - Java/React.js
Information Technology
- Mumbai, Maharashtra, India
Experience : 5 to 10 yearsKey Responsibilities Design & develop scalable full-stack applications. Architect system designs & microservices for high performance. Build backend services with Java, Spring Boot, Hibernate. Develop REST APIs & integ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in