Chennai, Tamil Nadu, India
Information Technology
Full-Time
Estuate, Inc.
Overview
Job Title : Data Engineer / Integration Engineer
Job Summary
We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.
Key Responsibilities
Job Summary
We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and workflows.
- Develop and optimize ETL/ELT processes using Python and workflow automation tools.
- Implement and manage data integration between various systems, including APIs and Oracle EBS.
- Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.
- Utilize Apache Spark or similar big data frameworks for efficient data processing.
- Develop robust API integrations for seamless data exchange between applications.
- Ensure data accuracy, consistency, and security across all systems.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
- Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.
- Document data workflows, processes, and best practices for future reference.
- Strong proficiency in Python for data engineering and workflow automation.
- Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar).
- Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).
- Expertise in big data processing frameworks, such as Apache Spark.
- Experience with API integrations (REST, SOAP, GraphQL) and handling structured/unstructured data.
- Strong problem-solving skills and ability to optimize data pipelines for performance.
- Experience working in an agile environment with CI/CD processes.
- Strong communication and collaboration skills.
- Experience with Ascend.io platform for data pipeline automation.
- Knowledge of SQL and NoSQL databases.
- Familiarity with Docker and Kubernetes for containerized workloads.
- Exposure to machine learning workflows is a plus.
- Opportunity to work on cutting-edge data engineering projects.
- Collaborative and dynamic work environment.
- Competitive compensation and benefits.
- Professional growth opportunities with exposure to the latest technologies.
Similar Jobs
View All
1 Day ago
Java Full Stack Developer
Information Technology
- Bangalore, Karnataka, India
Primary Skill - Java, Springboot, Angular, React.js Responsibilities: Lead and mentor a team of Java & Springboot Developers in the design, development, and maintenance of applications. Work with business stakeholders and technical teams to gather...
1 Day ago
Python Developer, Analyst, Firm Risk Management
Information Technology
- Bangalore, Karnataka, India
Morgan StanleyPython Developer - AnalystProfile DescriptionWe’re seeking someone to join our team as (Analyst - Python Developer) in (Credit Risk) division.Firm Risk ManagementIn the Firm Risk Management division, we advise businesses across the Fir...
1 Day ago
Junior SQL Developer/Software Integration Specialist
Information Technology
- Bangalore, Karnataka, India
Position : Junior SQL Developer / Software Integration SpecialistLocation : MumbaiExperience : Fresher or 1 Year of Relevant ExperienceJob Type : Full-timeDepartment : IT / DevelopmentKey skills : Sybase Power Builder/PB 6.5 /POWER BUILDERJob Overvi...
1 Day ago
Agile Coach
Information Technology
- Bangalore, Karnataka, India
Job PurposeResponsible to ensure a successful Agile adoption within the organization and thereby within the scrum teams and within the different organization disciplines. Lead the way to better deliver done-high-quality products, through continuous ...
1 Day ago
Python Developer - Data Platform
Information Technology
- Bangalore, Karnataka, India
Key Responsibilities Develop, maintain, and optimize robust data ingestion and ETL/ELT pipelines using Python on the Databricks platform. Work collaboratively with the architecture team to align implementation with long-term data strategies. Leve...
1 Day ago
AWS Admin And AWS Architect
Information Technology
- Bangalore, Karnataka, India
Primary skills:Technology->IOT Platform->AWS IOT A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and fa...
1 Day ago
Machine Learning Engineer - Data Modeling
Information Technology
- Bangalore, Karnataka, India
Role : Machine Learning and AI EngineerExp : 4+ YearsType : HybridLocation : Bangalore We are looking for a skilled Mid-Level AI Engineer with extensive experience in building full-stack AI solutions. The ideal candidate will have a strong foundat...
1 Day ago
Interesting Job Opportunity: Target Integration - Principal Software Engineer - Node.js/Python
Information Technology
- Chennai, Tamil Nadu, India
Key Responsibilities Drive the end-to-end architecture, design, and implementation of robust, scalable, and secure software systems. Define technical standards, frameworks, and best practices, ensuring delivery excellence. Collaborate with stakeh...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in