Bangalore, Karnataka, India
Information Technology
Full-Time
FOXO
Overview
About the Role:
We are looking for a Data Engineer with hands-on experience in building and optimizing scalable data pipelines and ETL workflows. The ideal candidate will have strong expertise in Python, Apache Spark, SQL, and Google Cloud Platform (GCP) services, with a proven track record of migrating and modernizing data systems from on-premise to cloud-based architectures.
Key Responsibilities:
- Design, develop, and maintain ETL and data processing pipelines using Apache Spark, PySpark, and Airflow.
- Lead data migration projects from legacy systems (e.g., Oracle, BODS) to cloud platforms like Google BigQuery.
- Build and optimize data pipelines for performance, scalability, and reliability.
- Integrate various data sources and manage structured and semi-structured data formats (e.g., EBCDIC, ASCII).
- Collaborate with cross-functional teams and external vendors for secure data transfer and pipeline orchestration.
- Implement data quality checks, error handling, and performance monitoring using tools such as Kibana and Grafana.
- Leverage GCP services including Dataproc, BigQuery, GCS, Cloud Functions, and Cloud Run for data transformation and orchestration.
- Maintain clear and detailed technical documentation for all data engineering processes.
- Contribute to process automation and workflow efficiency through custom scripting or tools like Playwright and Cron jobs.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 4–6 years of professional experience as a Data Engineer or in a similar role.
- Strong understanding of ETL principles, data modeling, and data governance.
- Hands-on experience in migrating data pipelines to the cloud.
- Excellent analytical, problem-solving, and communication skills.
Preferred Attributes:
- Experience with data warehouse modernization or cloud migration projects.
- Familiarity with Agile methodologies and cross-functional collaboration.
- Proven ability to optimize data workflows and automate reporting processes.
Similar Jobs
View All
16 Hours ago
Principal Architect - DotNet
Healthcare & Life Sciences
- 15 - 20 Yrs
- Chennai, Hyderabad
Summary role description:
Hiring Principal Architect – .NET Full Stack in the Healthcare Technology provider.
Company description:
Our client is a global technology and services provider with operations across the U.S. a...
16 Hours ago
Principal Architect - JAVA
Healthcare & Life Sciences
- 14 - 20 Yrs
Hiring for the Principal Architect - Java Full Stack for a healthcare technology leader advancing U.S. healthcare through AI and cloud innovation.
Company description:
Our client is a leading healthcare technology and clinical services ...
16 Hours ago
Full Stack Developer
Information Technology
- 5 - 8 Yrs
- Thane
About the Role
We are building advanced AI-powered enterprise products and are looking for a Node.js + UI Developer (React) to join our engineering team. This role involves end-to-end development of high-performance web applications, from backend ...
1 Day ago
Sr Technical Consultant
Information Technology
- 7 - 23 INR - Annual
- 5 - 8 Yrs
- Pune
Position: Sr. Technical Consultant (Dotnet 6.0+) Experience:
5+ Years
Job Title: ASP.NET Core 6.0 / Full stack Developer for Pune Location
We are looking for a seasoned ASP.NET Core 6.0 / MVC Developer to join our innovative team. This
ro...
1 Day ago
Mobile Engineer (React Native)
Information Technology
- 1200000 - 1800000 INR - Annual
- 3 - 6 Yrs
- Chennai
Job Description
About the Role
We are looking for a React Native Engineer to join our team in building robust, scalable, and high-performance mobile applications. You will work closely with engineers, designers, and product managers to deliver se...
1 Day ago
Senior AI/ML Engineer
Information Technology
- 2000000 - 2500000 INR - Annual
- 4 - 8 Yrs
- Chennai, Hyderabad
Role : Senior AI/ML Engineer
Experience : 4 - 8 years
Location: Chennai/Hyderabad
Work Mode: WFO
Roles & Responsibilities:
Design, implement, and deploy Machine Learning solutions to solve complex problems and deliver real busine...
1 Day ago
Junior Automation Tester - Selenium/Cypress
Information Technology
- Chennai, Tamil Nadu, India
DescriptionWe are seeking a motivated and enthusiastic Junior Automation Tester to join our Quality Assurance (QA) team.This role is ideal for recent graduates or those early in their career who have a foundational understanding of testing principle...
1 Day ago
Senior AI/Cloud Engineer
Information Technology
- Chennai, Tamil Nadu, India
Job DescriptionTechnical Expertise Experience: 5+ years of hands-on experience in cloud infrastructure engineering. IaC: Expert-level experience in writing and managing Terraform scripts/modules. Automation: Proficient in scripting with Python and B...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in