Free cookie consent management tool by TermsFeed Hadoop Senior Data Engineer/Consultant Specialist | Antal Tech Jobs
Back to Jobs
2 Days ago

Hadoop Senior Data Engineer/Consultant Specialist

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
HSBC

Overview

Job description

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an exprienced professional to join our team in the role of Consultant Specialist

In this role, you will:

  • Data Pipelines Integration and Management:
  • Expertise in Scala-Spark/Python-Spark development and should be able to Work with Agile application dev team to implement data strategies.
  • Design and implement scalable data architectures to support the bank's data needs.
  • Develop and maintain ETL (Extract, Transform, Load) processes.
  • Ensure the data infrastructure is reliable, scalable, and secure.
  • Oversee the integration of diverse data sources into a cohesive data platform.
  • Ensure data quality, data governance, and compliance with regulatory requirements.
  • Monitor and optimize data pipeline performance.
  • Troubleshoot and resolve data-related issues promptly.
  • Implement monitoring and alerting systems for data processes.
  • Troubleshoot and resolve technical issues optimizing system performance ensuring reliability
  • Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team
  • Implementing and monitoring solutions that identify both system bottlenecks and production issues
Requirements

To be successful in this role, you should meet the following requirements:

  • 5+ years of experience in data engineering or related field and hands-on experience of building and maintenance of ETL Data pipelines
  • Good experience in Designing and Developing Spark Applications using Scala or Python.
  • Good experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark)
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Optimization and Performance Tuning of Spark Applications
  • GIT Experience on creating, merging and managing Repos.
  • Perform unit testing and performance testing.
  • Good understanding of ETL processes and data pipeline orchestration tools like Airflow, Control-M.
  • Strong problem-solving skills and ability to work under pressure.
  • Excellent communication and interpersonal skills.
  • The successful candidate will also meet the following requirements: (Good to have Requirements)
  • Experience in the banking or financial services industry.
  • Familiarity with regulatory requirements related to data security and privacy in the banking sector.
  • Experience with cloud platforms (Google Cloud) and their data services.
  • Certifications in cloud platforms (AWS Certified Data Analytics, Google Professional Data Engineer, etc.).

You’ll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSDI

Share job
Similar Jobs
View All
5 Hours ago
Software Engineer - C#/Javascript
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Job Description : We are searching for a Software Engineer who is experienced in C#, .NET technologies, and web technologies (Angular, Aurelia). Join our collaborative team, where you'll work together on exciting projects, designing, building, and...
decor
5 Hours ago
Node.js Developer
Information Technology
  • 2 - 6 Yrs
  • Anywhere in India/Multiple Locations
Job Description: We are looking for a skilled Node.js Developer to join our backend engineering team. The ideal candidate will be responsible for building scalable server-side applications, working on API development, and integrating with database...
decor
6 Hours ago
Frontend Developer
Information Technology
  • 2 - 7 Yrs
  • Anywhere in India/Multiple Locations
Experience Level: 2+ Years Employment Type: Full-Time About the Role: We are looking for a talented Frontend Developer with expertise in React.js to build interactive and responsive web interfaces. You will work closely with backend developers,...
decor
1 Day ago
Business Analyst (PDM) (H/F) - AIRBUS INDIA PRIVATE LIMITED
Information Technology
Job Description: Role: Business Analyst (PDM) Description: The Business Analyst - PDM is part of IIDPPT siglum located in India. He/she is responsible for the PDM and PDM related legacy products here in India. Success of this position will requir...
decor
1 Day ago
Automation Test Lead - Senior Associate - Operate
Information Technology
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to ...
decor
1 Day ago
Canvas App, Power Apps, Power automation / Senior Software Engineer
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
decor
1 Day ago
CCaaS Business Analyst-Senior Associate
Information Technology
A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabi...
decor
1 Day ago
Sustainability- Technology & Innovation - Full Stack Developer (Gen AI & Cloud) - Senior Associate
Information Technology
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media