Bangalore, Karnataka, India
Information Technology
Full-Time
Estuate, Inc.
Overview
We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.
Responsibilities
Responsibilities
- Design, build, and maintain scalable data pipelines and workflows.
- Develop and optimize ETL/ELT processes using Python and workflow automation tools.
- Implement and manage data integration between various systems, including APIs and Oracle EBS.
- Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.
- Utilize Apache Spark or similar big data frameworks for efficient data processing.
- Develop robust API integrations for seamless data exchange between applications.
- Ensure data accuracy, consistency, and security across all systems.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
- Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.
- Document data workflows, processes, and best practices for future reference.
- Strong proficiency in Python for data engineering and workflow automation.
- Experience with workflow orchestration tools (e. g., Apache Airflow, Prefect, or similar).
- Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).
- Expertise in big data processing frameworks, such as Apache Spark.
- Experience with API integrations (REST, SOAP, GraphQL) and handling structured/unstructured data.
- Strong problem-solving skills and ability to optimize data pipelines for performance.
- Experience working in an agile environment with CI/CD processes.
- Strong communication and collaboration skills.
- Experience with the Ascend.io platform for data pipeline automation.
- Knowledge of SQL and NoSQL databases.
- Familiarity with Docker and Kubernetes for containerized workloads.
- Exposure to machine learning workflows is a plus.
Similar Jobs
View All
1 Day ago
Sr. Software Engineer - HTML/Angular Job
Information Technology
- Bangalore, Karnataka, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
Devops Engineer
Information Technology
- Bangalore, Karnataka, India
Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to...
1 Day ago
.Net Developer - Intermediate
Information Technology
- Bangalore, Karnataka, India
Job Description: As a .NET Developer, you will be a key contributor to our team, driving the design, development, and maintenance of high-performance, scalable applications. You will leverage your deep expertise in .NET technologies and cloud platfo...
1 Day ago
Junior Web Developer in Hyderabad
Information Technology
- Bangalore, Karnataka, India
Key Responsibilities Meeting with the development team to discuss user interface ideas and applications Reviewing application requirements and interface designs Identifying web-based user interactions Developing and implementing highly responsiv...
1 Day ago
Sr. Software Engineer - .Net + Azure Job
Information Technology
- Bangalore, Karnataka, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
Mainframe Modernization Consult System Architect
Information Technology
- Bangalore, Karnataka, India
Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to...
1 Day ago
Onelab Ventures - Scrum Master/IT Project Manager
Information Technology
- Bangalore, Karnataka, India
Job SummaryWe are seeking an experienced IT Project Manager to lead and manage end-to-end delivery of projects involving Python Full Stack development, Cloud platforms (AWS/Azure/GCP), and Machine Learning solutions.ResponsibilitiesThe ideal candida...
1 Day ago
Network Architect
Information Technology
- Bangalore, Karnataka, India
Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in