Free cookie consent management tool by TermsFeed Data Engineer - Controls Technology | Antal Tech Jobs
Back to Jobs
3 Days ago

Data Engineer - Controls Technology

decor
Hyderabad, Telangana, India
Information Technology
Full-Time
Citi

Overview

We are seeking a highly skilled and hands-on Data Engineer to join Controls Technology to support the design, development, and implementation of our next-generation Data Mesh and Hybrid Cloud architecture. This role is critical in building scalable, resilient, and future-proof data pipelines and infrastructure that enable the seamless integration of Controls Technology data within a unified platform. The Data Engineer will work closely with the Data Mesh and Cloud Architect Lead to implement data products, ETL/ELT pipelines, hybrid cloud integrations, and governance frameworks that support data-driven decision-making across the enterprise.

Key Responsibilities:

Data Pipeline Development:

  • Design, build, and optimize ETL/ELT pipelines for structured and unstructured data.
  • Develop real-time and batch data ingestion pipelines using distributed data processing frameworks.
  • Ensure pipelines are highly performant, cost-efficient, and secure.

Apache Iceberg & Starburst Integration:

  • Work extensively with Apache Iceberg for data lake storage optimization and schema evolution.
  • Manage Iceberg Catalogs and ensure seamless integration with query engines.
  • Configure and maintain Hive MetaStore (HMS) for Iceberg-backed tables and ensure proper metadata management.
  • Utilize Starburst and Stargate to enable distributed SQL-based analytics and seamless data federation.
  • Optimize performance tuning for large-scale querying and federated access to structured and semi-structured data.

Data Mesh Implementation:

  • Implement Data Mesh principles by developing domain-specific data products that are discoverable, interoperable, and governed.
  • Collaborate with data domain owners to enable self-service data access while ensuring consistency and quality.

Hybrid Cloud Data Integration:

  • Develop and manage data storage, processing, and retrieval solutions across AWS and on-premise environments.
  • Work with cloud-native tools such as AWS S3, RDS, Lambda, Glue, Redshift, and Athena to support scalable data architectures.
  • Ensure hybrid cloud data flows are optimized, secure, and compliant with organizational standards.

Data Governance & Security:

  • Implement data governance, lineage tracking, and metadata management solutions.
  • Enforce security best practices for data encryption, role-based access control (RBAC), and compliance with policies such as GDPR and CCPA.

Performance Optimization & Monitoring:

  • Monitor and optimize data workflows, performance tuning of queries, and resource utilization.
  • Implement logging, alerting, and monitoring solutions using CloudWatch, Prometheus, or Grafana to ensure system health.

Collaboration & Documentation:

  • Work closely with data architects, application teams, and business units to ensure seamless integration of data solutions.
  • Maintain clear documentation of data models, transformations, and architecture for internal reference and governance.

Required Technical Skills:

Programming & Scripting:

  • Strong proficiency in Python, SQL, and Shell scripting.
  • Experience with Scala or Java is a plus.

Data Processing & Storage:

  • Hands-on experience with Apache Spark, Kafka, Flink, or similar distributed processing frameworks.
  • Strong knowledge of relational (PostgreSQL, MySQL, Oracle) and NoSQL databases (DynamoDB, MongoDB).
  • Expertise in Apache Iceberg for managing large-scale data lakes, schema evolution, and ACID transactions.
  • Experience working with Iceberg Catalogs, Hive MetaStore (HMS), and integrating Iceberg-backed tables with query engines.
  • Familiarity with Starburst and Stargate for federated querying and cross-platform data access.

Cloud & Hybrid Architecture:

  • Experience working with AWS data services (S3, Redshift, Glue, Athena, EMR, RDS).
  • Understanding of hybrid data storage and integration between on-prem and cloud environments.

Infrastructure as Code (IaC) & DevOps:

  • Experience with Terraform, AWS CloudFormation, or Kubernetes for provisioning infrastructure.
  • CI/CD pipeline experience using GitHub Actions, Jenkins, or GitLab CI/CD.

Data Governance & Security:

  • Familiarity with data cataloging, lineage tracking, and metadata management.
  • Understanding of RBAC, IAM roles, encryption, and compliance frameworks (GDPR, SOC2, etc.).

Required Soft Skills:

  • Problem-Solving & Analytical Thinking - Ability to troubleshoot complex data issues and optimize workflows.
  • Collaboration & Communication - Comfortable working with cross-functional teams and articulating technical concepts to non-technical stakeholders.
  • Ownership & Proactiveness - Self-driven, detail-oriented, and able to take ownership of tasks with minimal supervision.
  • Continuous Learning - Eager to explore new technologies, improve skill sets, and stay ahead of industry trends.

Qualifications:

  • 4-6 years of experience in data engineering, cloud infrastructure, or distributed data processing.
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • Hands-on experience with data pipelines, cloud services, and large-scale data platforms.
  • Strong foundation in SQL, Python, Apache Iceberg, Starburst, and cloud-based data solutions (AWS preferred), Apache Airflow Orchestration

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Data Architecture

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.
Share job
Similar Jobs
View All
1 Day ago
Business Analyst
Information Technology
  • Ahmedabad, Gujarat, India
About UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics ...
decor
1 Day ago
Lead Software Engineer-2
Information Technology
  • Ahmedabad, Gujarat, India
As a Front-End Developer, you will design and build user interfaces for both internal and customer-facing products. You’ll work closely with Engineers, Data Scientists, DevOps, and Product Managers to deliver intuitive, responsive user experiences. ...
decor
1 Day ago
Data Engineer
Information Technology
  • Ahmedabad, Gujarat, India
About SanofiWe are an innovative global healthcare company, driven by one purpose: we chase the miracles of science to improve people’s lives. Our team, across some 100 countries, is dedicated to transforming the practice of medicine by working to t...
decor
1 Day ago
Data Architect
Information Technology
  • Ahmedabad, Gujarat, India
DataArchitecture Design: Develop and maintain a comprehensive data architecture strategy that aligns with the business objectives and technology landscape. DataModeling:Createand managelogical, physical, and conceptual data models to support variou...
decor
1 Day ago
Full Stack Developer in Hyderabad
Information Technology
  • Dehra dun, Uttarakhand, India
Key Responsibilities Develop robust, scalable, and secure web applications Collaborate with the design team to ensure the technical feasibility of UI/UX designs Implement responsive web designs to ensure compatibility across various devices and s...
decor
1 Day ago
Associate DevOps Engineer (AWS)
Information Technology
  • Dehra dun, Uttarakhand, India
Job DescriptionJob summary:We are seeking a highly experienced DevOps Engineer with a deep focus on AWS and Infrastructure as Code using Terraform. This role requires a self-motivated individual who thrives in a fast-paced, highly technical environm...
decor
1 Day ago
Cyfuture - Artificial Intelligence/Machine Learning Engineer - LLM
Information Technology
  • Dehra dun, Uttarakhand, India
Position Title : AI/ML Engineer.Company : Cyfuture India Pvt.Ltd.Industry : IT Services and IT Consulting.Location : Sector 81, NSEZ, Noida (5 Days Work From Office).About CyfutureCyfuture is a trusted name in IT services and cloud infrastructure, o...
decor
1 Day ago
DOT NET Developer (Microservices)
Information Technology
  • Dehra dun, Uttarakhand, India
Company OverviewAt Webito Infotech, we are a young and enthusiastic team with a passion for technology. We embrace innovation and think big, unafraid to stand out from the crowd. We believe that every aspect of web pages and app UI can create a uniq...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media