Hyderabad, Telangana, India
Information Technology
Full-Time
Citi
Overview
Data Engineer – Big Data Platforms
Job Summary:
We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Big Data platforms and a strong background in designing, developing, and maintaining data pipelines. You will be responsible for ensuring data quality, optimizing data workflows, and working with distributed data systems. This role requires a deep understanding of modern data engineering workflows, ETL processes, and large-scale data processing.
Key Responsibilities:
Data Engineering:
Job Summary:
We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Big Data platforms and a strong background in designing, developing, and maintaining data pipelines. You will be responsible for ensuring data quality, optimizing data workflows, and working with distributed data systems. This role requires a deep understanding of modern data engineering workflows, ETL processes, and large-scale data processing.
Key Responsibilities:
Data Engineering:
- Design, develop, and maintain scalable and efficient data pipelines to support business needs.
- Implement ETL/ELT processes to extract, transform, and load data from various sources into Big Data platforms.
- Optimize data workflows for performance, scalability, and reliability.
- Work with Big Data technologies such as Hadoop, Spark, Hive, or HDFS to process and analyze large datasets.
- Develop distributed data processing pipelines using Spark (PySpark/Scala) and MapReduce.
- Optimize Big Data workflows for performance and scalability.
- Integrate data from multiple sources, including APIs, flat files, and third-party systems.
- Collaborate with data analysts, data scientists, and business teams to understand data requirements.
- Ensure data accuracy, consistency, and integrity across systems.
- Implement data validation and error-handling mechanisms.
- Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.
- Document data pipelines, data designs, and processes for future reference.
- Technical Expertise:
- Expertise in Big Data platforms:
- Experience with Hadoop, Spark (PySpark/Scala), Hive, or HDFS for distributed data processing.
- Proficiency in SQL and database design principles.
- Experience with ETL/ELT tools (e.g., Informatica, Talend, or Python-based ETL frameworks).
- Programming Skills:
- Proficiency in scripting languages such as Python, Scala, or Shell scripting for data processing and automation.
- Data Governance:
- Knowledge of data quality, data governance, and data security best practices.
- Soft Skills:
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
- 7-9 years of relevant experience
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Working knowledge of consulting/project management techniques/methods
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
- Bachelor’s degree/University degree or equivalent experience
Qualifications:
------------------------------------------------------
Job Family Group:
Technology
------------------------------------------------------
Job Family:
Applications Development
------------------------------------------------------
Time Type:
Full time
------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.
------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
Similar Jobs
View All
1 Day ago
Technical Lead
Information Technology
- 7 - 14 Yrs
- Bengaluru
Experience: 7 + Years
Job Type: Full Time Hybrid
Job Location: Bangalore/ Mangalore
Job Description: We are seeking a highly skilled Senior Full Stack Engineer with hands-on experience in building, deploying, and maintaining modern serverles...
1 Day ago
Senior Software Engineer
Information Technology
- 5 - 12 Yrs
- Bengaluru
In this role, you will:
Lead complex technology initiatives including those that are companywide with broad impact
Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technol...
1 Day ago
Software Engineer
Information Technology
- 2 - 10 Yrs
- Bengaluru
JOB DESCRIPTION:
As a software engineer, you will collaborate with a team of talented individuals to create products
that change the way restaurant operators manage their enterprise. We’re looking for ideas from
every facet of computer scien...
1 Day ago
Software Developer in Gurgaon
Information Technology
- Chennai, Tamil Nadu, India
Are you a skilled Software Developer with expertise in Natural Language Processing (NLP), LLM Ops, LLM evaluation, Model fine-tuning, Artificial intelligence, Generative AI Tools, Machine Learning, Machine Learning Operations (MLOps), and Cursor (Ge...
1 Day ago
Software Engineer - Test
Information Technology
- Chennai, Tamil Nadu, India
Job Description Preferred 2+ Years of experience in Manual testing. (preferred in Energy domain) Automation testing- Selenium knowledge added advantage. Strong experience in Web applications. (Mobile Applications will be added advantage) Strong ...
1 Day ago
SAP ABAP Technical Lead
Information Technology
- Chennai, Tamil Nadu, India
Job Description Strong SAP technology experience in multiple business and technical processes Profound ABAP development experience and expert in Performance Tuning ABAP Workbench, Report Programming, Module Programming, Authorizations, ABAP OOPS,...
1 Day ago
Java Software Developer, Trilogy (Remote) - $60,000/year USD
Information Technology
- Chennai, Tamil Nadu, India
Are you the kind of engineer who cringes at sloppy code, gets frustrated by deployment delays, and refuses to settle for yesterday's development methods? Do you see beyond mere programming to envision AI-powered systems that make conventional engine...
1 Day ago
Interesting Job Opportunity: iOS Developer - Objective C/SWIFT
Information Technology
- Chennai, Tamil Nadu, India
Job DescriptionWe are looking for a skilled and enthusiastic iOS Developer to join our team. The candidate will have experience developing and maintaining mobile applications on the iOS platform and possess a passion for creating user-friendly and h...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in