Free cookie consent management tool by TermsFeed Data Engineer - Controls Technology | Antal Tech Jobs
Back to Jobs
14 Weeks ago

Data Engineer - Controls Technology

decor
Mumbai, Maharashtra, India
Information Technology
Full-Time
Citi

Overview

We are seeking a highly skilled and hands-on Data Engineer to join Controls Technology to support the design, development, and implementation of our next-generation Data Mesh and Hybrid Cloud architecture. This role is critical in building scalable, resilient, and future-proof data pipelines and infrastructure that enable the seamless integration of Controls Technology data within a unified platform. The Data Engineer will work closely with the Data Mesh and Cloud Architect Lead to implement data products, ETL/ELT pipelines, hybrid cloud integrations, and governance frameworks that support data-driven decision-making across the enterprise.

Key Responsibilities:

Data Pipeline Development:

  • Design, build, and optimize ETL/ELT pipelines for structured and unstructured data.
  • Develop real-time and batch data ingestion pipelines using distributed data processing frameworks.
  • Ensure pipelines are highly performant, cost-efficient, and secure.

Apache Iceberg & Starburst Integration:

  • Work extensively with Apache Iceberg for data lake storage optimization and schema evolution.
  • Manage Iceberg Catalogs and ensure seamless integration with query engines.
  • Configure and maintain Hive MetaStore (HMS) for Iceberg-backed tables and ensure proper metadata management.
  • Utilize Starburst and Stargate to enable distributed SQL-based analytics and seamless data federation.
  • Optimize performance tuning for large-scale querying and federated access to structured and semi-structured data.

Data Mesh Implementation:

  • Implement Data Mesh principles by developing domain-specific data products that are discoverable, interoperable, and governed.
  • Collaborate with data domain owners to enable self-service data access while ensuring consistency and quality.

Hybrid Cloud Data Integration:

  • Develop and manage data storage, processing, and retrieval solutions across AWS and on-premise environments.
  • Work with cloud-native tools such as AWS S3, RDS, Lambda, Glue, Redshift, and Athena to support scalable data architectures.
  • Ensure hybrid cloud data flows are optimized, secure, and compliant with organizational standards.

Data Governance & Security:

  • Implement data governance, lineage tracking, and metadata management solutions.
  • Enforce security best practices for data encryption, role-based access control (RBAC), and compliance with policies such as GDPR and CCPA.

Performance Optimization & Monitoring:

  • Monitor and optimize data workflows, performance tuning of queries, and resource utilization.
  • Implement logging, alerting, and monitoring solutions using CloudWatch, Prometheus, or Grafana to ensure system health.

Collaboration & Documentation:

  • Work closely with data architects, application teams, and business units to ensure seamless integration of data solutions.
  • Maintain clear documentation of data models, transformations, and architecture for internal reference and governance.

Required Technical Skills:

Programming & Scripting:

  • Strong proficiency in Python, SQL, and Shell scripting.
  • Experience with Scala or Java is a plus.

Data Processing & Storage:

  • Hands-on experience with Apache Spark, Kafka, Flink, or similar distributed processing frameworks.
  • Strong knowledge of relational (PostgreSQL, MySQL, Oracle) and NoSQL databases (DynamoDB, MongoDB).
  • Expertise in Apache Iceberg for managing large-scale data lakes, schema evolution, and ACID transactions.
  • Experience working with Iceberg Catalogs, Hive MetaStore (HMS), and integrating Iceberg-backed tables with query engines.
  • Familiarity with Starburst and Stargate for federated querying and cross-platform data access.

Cloud & Hybrid Architecture:

  • Experience working with AWS data services (S3, Redshift, Glue, Athena, EMR, RDS).
  • Understanding of hybrid data storage and integration between on-prem and cloud environments.

Infrastructure as Code (IaC) & DevOps:

  • Experience with Terraform, AWS CloudFormation, or Kubernetes for provisioning infrastructure.
  • CI/CD pipeline experience using GitHub Actions, Jenkins, or GitLab CI/CD.

Data Governance & Security:

  • Familiarity with data cataloging, lineage tracking, and metadata management.
  • Understanding of RBAC, IAM roles, encryption, and compliance frameworks (GDPR, SOC2, etc.).

Required Soft Skills:

  • Problem-Solving & Analytical Thinking - Ability to troubleshoot complex data issues and optimize workflows.
  • Collaboration & Communication - Comfortable working with cross-functional teams and articulating technical concepts to non-technical stakeholders.
  • Ownership & Proactiveness - Self-driven, detail-oriented, and able to take ownership of tasks with minimal supervision.
  • Continuous Learning - Eager to explore new technologies, improve skill sets, and stay ahead of industry trends.

Qualifications:

  • 4-6 years of experience in data engineering, cloud infrastructure, or distributed data processing.
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • Hands-on experience with data pipelines, cloud services, and large-scale data platforms.
  • Strong foundation in SQL, Python, Apache Iceberg, Starburst, and cloud-based data solutions (AWS preferred), Apache Airflow Orchestration

-

Job Family Group:

Technology

-

Job Family:

Technology Project Management

-

Time Type:

Full time

-

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting

Share job
Similar Jobs
View All
1 Day ago
Software Engineer - Backend Development
Information Technology
  • Indore, Madhya Pradesh, India
Job Title : Software Engineer BackendLocation : Bengaluru, IndiaPosition Summary : We are looking for an experienced Software Engineer Backend with expertise in Python, object-oriented programming, Django, and Node.js. The ideal candidate should als...
decor
1 Day ago
Python Full Stack Developer in Hyderabad
Information Technology
  • Indore, Madhya Pradesh, India
Key Responsibilities Write reusable, testable, and efficient code Design and implement low-latency, high-availability, and performant applications Integrate user-facing elements developed by front-end developers with server-side logic Implement ...
decor
1 Day ago
Studio Diseno Innovative - Senior Business Analyst
Information Technology
  • Indore, Madhya Pradesh, India
Job DescriptionThe impact that you will be makingThe role would require you to give end-to-end support to the product development and analytics services teams and maintain a strong relationship with our clients.What Lands You In This Role 3-6 years...
decor
1 Day ago
Technical Project Manager - Full Stack Development
Information Technology
  • Indore, Madhya Pradesh, India
Job Title : Full Stack ( With (Technical Project Manager)Location : Bengaluru, IndiaExperience : 7-8 yearsRole OverviewWe are looking for a proactive and technically strong Technical Project Manager (TPM) to drive the successful delivery of cloud-na...
decor
1 Day ago
Nihilent Technologies - Data Architect - ETL Platform
Information Technology
  • Indore, Madhya Pradesh, India
Designation : Data Architect.Location : Pune.Experience : 10-15 years.Job DescriptionRole & Responsibilities : The architect should have experience in architecting large scale analytics solutions using native services such as Azure Synapse, Data La...
decor
1 Day ago
Interesting Job Opportunity: Full Stack Developer - .Net/AngularJS
Information Technology
  • Indore, Madhya Pradesh, India
Job DescriptionWe are seeking an experienced and .NET full stack Developer with 3 to 6 years of hands-on development experience to join our growing team. The ideal candidate will be a skilled software engineer who can drive the development of .NET C...
decor
1 Day ago
Studio Diseno Innovative - Java Software Engineer - Spring/Microservices Architecture
Information Technology
  • Indore, Madhya Pradesh, India
Job DescriptionResponsibilities : Understand project requirements and translate them into technical solutions. Develop and maintain Java-based applications with a focus on efficiency, reliability, and scalability. Utilize Core Java, JSP, and Serv...
decor
1 Day ago
Data Engineer - Spark/Apache Flink
Information Technology
  • Indore, Madhya Pradesh, India
Required Skills Proficiency in multiple programming languages ideally Python Proficiency in at least one cluster computing frameworks (preferably Spark, alternatively Flink or Storm) Proficiency in at least one cloud data lakehouse platforms (pre...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media