Free cookie consent management tool by TermsFeed Senior Data Engineer - Pyspark - Assistant Vice President | Antal Tech Jobs
Back to Jobs
5 Days ago

Senior Data Engineer - Pyspark - Assistant Vice President

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
Citi

Overview

The Data Engineer is accountable for developing high quality data products to support the

Bank’s regulatory requirements and data driven decision making. A Data Engineer will serve

as an example to other team members, work closely with customers, and remove or

escalate roadblocks. By applying their knowledge of data architecture standards, data

warehousing, data structures, and business intelligence they will contribute to business

outcomes on an agile team.

Responsibilities: -

Developing and supporting scalable, extensible, and highly available data solutions

Deliver on critical business priorities while ensuring alignment with the wider

architectural vision

Identify and help address potential risks in the data supply chain

Follow and contribute to technical standards

Design and develop analytical data models

Required Qualifications & Work Experience

  • First Class Degree in Engineering/Technology (4-year graduate course)
  • 9 to 11 years’ experience implementing data-intensive solutions using agile
  • methodologies
  • Experience of relational databases and using SQL for data querying, transformation
  • and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through
  • self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor; an ability to lead and deliver medium sized components independently

Technical Skills (Must Have)

ETL:Hands on experience of building data pipelines. Proficiency in two or more data integration platforms such as Ab Initio, Apache Spark, Talend and Informatica

Big Data: Experience of ‘big data’ platforms such as Hadoop, Hive or Snowflake for data storage and processing

Data Warehousing & Database Management: Expertise around Data Warehousing concepts, Relational (Oracle, MSSQL, MySQL) and NoSQL (MongoDB, DynamoDB) database design

Data Modeling & Design: Good exposure to data modeling techniques; design, optimization and maintenance of data models and data structures

Languages: Proficient in one or more programming languages commonly used in data engineering such as Python, Java or Scala

DevOps: Exposure to concepts and enablers - CI/CD platforms, version control, automated quality control management

Data Governance:A strong grasp of principles and practice including data quality, security, privacy and compliance

Technical Skills (Valuable)

Ab Initio: Experience developing Co>Op graphs; ability to tune for performance.

Demonstrable knowledge across full suite of Ab Initio toolsets e.g., GDE, Express>IT,

Data Profiler and Conduct>IT, Control>Center, Continuous>Flows

Cloud: Good exposure to public cloud data platforms such as S3, Snowflake,

Redshift, Databricks, BigQuery, etc. Demonstratable understanding of underlying

architectures and trade-offs

Data Quality & Controls: Exposure to data validation, cleansing, enrichment and

data controls

Containerization: Fair understanding of containerization platforms like Docker,

Kubernetes

File Formats:Exposure in working on Event/File/Table Formats such as Avro,

Parquet, Protobuf, Iceberg, Delta

Others:

Experience of using a Job scheduler e.g., Autosys. Exposure to Business

Intelligence tools e.g., Tableau, Power BI

Certification on any one or more of the above topics would be an advantage

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Digital Software Engineering

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.
Share job
Similar Jobs
View All
1 Day ago
Software Engineer
Information Technology
  • 900000 - 900000 INR - Yearly
  • Noida, Uttar Pradesh, India
Job Title: MERN Stack Developer Location: Noida (On-site) Experience: 2 – 3 Years Working Days: 6 Days a Week Budget: Up to ₹9 LPA About GoodSpace GoodSpace is an AI-powered HR Tech platform revolutionizing how companies discover, evaluate, and hire...
decor
1 Day ago
Associate Software Developer in Gautam Buddha Nagar, Noida
Information Technology
  • Noida, Uttar Pradesh, India
Are you a talented and ambitious Java Developer looking to take your career to the next level? Namekart is seeking a dynamic Associate Software Developer to join our innovative team in the NOIDA office.As an integral member of our software developme...
decor
1 Day ago
DevOps Engineer
Information Technology
  • Noida, Uttar Pradesh, India
Job Title: Dev Ops EngineerStreamGradeReporting ToLocationSoftware Development ManagerBangalorePurposeThe DevOps Engineer will be responsible for designing and maintaining robust automated build systems, managing source control repositories, and int...
decor
1 Day ago
Software Developer
Information Technology
  • Noida, Uttar Pradesh, India
Role Description This is a full-time remote role for a Software Developer at Employer Connect. The Software Developer will be responsible for designing, developing, and maintaining software applications. Day-to-day tasks include writing clean, scala...
decor
1 Day ago
Java Developer
Information Technology
  • Noida, Uttar Pradesh, India
Responsibilities Design, develop, and maintain high-quality Java-based microservices using frameworks like Spring Boot. Implement and manage Apache Kafka for messaging, event streaming, and real-time data processing. Collaborate with cross-functiona...
decor
1 Day ago
Technical Lead
Information Technology
  • Noida, Uttar Pradesh, India
Job DescriptionNokia’s Network Services Platform (NSP) is the network automation platform of choice for the world’s most advanced communications service providers, and as a Senior Software Engineer on the Network Automation team, you'll leverage you...
decor
1 Day ago
Expert DevOps Engineer
Information Technology
  • Noida, Uttar Pradesh, India
This job is with Finastra, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who are we?At Finastra, we are a dynamic global provider of open...
decor
1 Day ago
WordPress + PHP Developer
Information Technology
  • 180000 - 180000 INR - Yearly
  • Noida, Uttar Pradesh, India
Experience: 1-2 Years in PHP WordPress Budget : INR 1.8LPA - 3LPA Develop and maintain WordPress-based websites and custom themes/plugi ns.Work with PHP, MySQL, HTML5, CSS3, JavaScript, and jQue ry.Integrate third-party APIs and troubleshoot is...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media