Free cookie consent management tool by TermsFeed Data Engineer - Pyspark - C12 - Chennai | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer - Pyspark - C12 - Chennai

decor
Ahmedabad, Gujarat, India
Information Technology
Full-Time
Citigroup

Overview

The Data Engineer is accountable for developing high quality data products to support the

Bank’s regulatory requirements and data driven decision making. A Data Engineer will serve

as an example to other team members, work closely with customers, and remove or

escalate roadblocks. By applying their knowledge of data architecture standards, data

warehousing, data structures, and business intelligence they will contribute to business

outcomes on an agile team.

Responsibilities: -

Developing and supporting scalable, extensible, and highly available data solutions

Deliver on critical business priorities while ensuring alignment with the wider

architectural vision

Identify and help address potential risks in the data supply chain

Follow and contribute to technical standards

Design and develop analytical data models

Required Qualifications & Work Experience

  • First Class Degree in Engineering/Technology (4-year graduate course)
  • 9 to 11 years’ experience implementing data-intensive solutions using agile
  • methodologies
  • Experience of relational databases and using SQL for data querying, transformation
  • and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through
  • self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor; an ability to lead and deliver medium sized components independently

Technical Skills (Must Have)

ETL:Hands on experience of building data pipelines. Proficiency in two or more data integration platforms such as Ab Initio, Apache Spark, Talend and Informatica

Big Data: Experience of ‘big data’ platforms such as Hadoop, Hive or Snowflake for data storage and processing

Data Warehousing & Database Management: Expertise around Data Warehousing concepts, Relational (Oracle, MSSQL, MySQL) and NoSQL (MongoDB, DynamoDB) database design

Data Modeling & Design: Good exposure to data modeling techniques; design, optimization and maintenance of data models and data structures

Languages: Proficient in one or more programming languages commonly used in data engineering such as Python, Java or Scala

DevOps: Exposure to concepts and enablers - CI/CD platforms, version control, automated quality control management

Data Governance:A strong grasp of principles and practice including data quality, security, privacy and compliance

Technical Skills (Valuable)

Ab Initio: Experience developing Co>Op graphs; ability to tune for performance.

Demonstrable knowledge across full suite of Ab Initio toolsets e.g., GDE, Express>IT,

Data Profiler and Conduct>IT, Control>Center, Continuous>Flows

Cloud: Good exposure to public cloud data platforms such as S3, Snowflake,

Redshift, Databricks, BigQuery, etc. Demonstratable understanding of underlying

architectures and trade-offs

Data Quality & Controls: Exposure to data validation, cleansing, enrichment and

data controls

Containerization: Fair understanding of containerization platforms like Docker,

Kubernetes

File Formats:Exposure in working on Event/File/Table Formats such as Avro,

Parquet, Protobuf, Iceberg, Delta

Others:

Experience of using a Job scheduler e.g., Autosys. Exposure to Business

Intelligence tools e.g., Tableau, Power BI

Certification on any one or more of the above topics would be an advantage

-

Job Family Group:

Technology

-

Job Family:

Digital Software Engineering

-

Time Type:

Full time

-

Most Relevant Skills

Please see the requirements listed above.

-

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

-

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Share job
Similar Jobs
View All
1 Day ago
Head of AI Cybersecurity
Information Technology
  • 8 - 13 Yrs
  • Chennai, Mumbai (All Areas)
Location: Mumbai & Chennai- Hybrid (1 week WFO in a month) | Experience: 8+ years Type: Full-time Seeking a visionary and hands-on Head of AI Cybersecurity to lead the end-to-end security of AI/ML systems. This role will drive strategy, implement...
decor
1 Day ago
Intern-AI Engineer
Finance & Banking
  • Pune, Maharashtra, India
Scopely is looking for an Intern - AI Engineer to join our Gen AI team in Bangalore!At Scopely, we care deeply about what we do and want to inspire play, every day - whether in our work environments alongside our talented colleagues, or through our ...
decor
1 Day ago
Software Developer - PHP/Laravel
Finance & Banking
  • Pune, Maharashtra, India
Software Developer (Laravel/PHP)Location : MumbaiWorking Mode : On-siteExperience : 1-5 YearsAbout The RoleKey Responsibilities : Collaborate with cross-functional teams to understand project requirements, define scope, and determine best practices...
decor
1 Day ago
GenAI Data Scientist - Manager
Finance & Banking
  • Pune, Maharashtra, India
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data...
decor
1 Day ago
Java Developer - C11
Finance & Banking
  • Pune, Maharashtra, India
The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technolo...
decor
1 Day ago
Trademo - Lead Data/AI Engineer
Finance & Banking
  • Pune, Maharashtra, India
About TrademoAt Trademo, we are transforming global trade and supply chains by leveraging cutting-edge AI technology to provide businesses with unparalleled visibility, compliance, and intelligence solutions.Our AI-driven platform simplifies the com...
decor
1 Day ago
Senior Web Developer- C11 - CHENNAI
Finance & Banking
  • Pune, Maharashtra, India
The Digital S/W Engineer Intmd Analyst is a developing professional role. Deals with most problems independently and has some latitude to solve complex problems. Integrates in-depth specialty area knowledge with a solid understanding of industry sta...
decor
1 Day ago
GenAI Data Scientist - Manager
Finance & Banking
  • Pune, Maharashtra, India
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media