Data Engineer PySpark | Python | Kafka | GCP | Data bricks/Consultant Specialist

Job Description

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Marketing Title.

In this role, you will:

• Design, develop, and maintain scalable ETL/ELT pipelines using PySpark and Python.
• Build and manage real-time data ingestion and streaming pipelines using Apache Kafka.
• Develop and optimize data workflows and batch processes on GCP using services like BigQuery, Dataflow, Pub/Sub, and Cloud Composer.
• Implement data quality checks, error handling, and monitoring across pipelines.
• Collaborate with data scientists, analysts, and business teams to translate requirements into technical solutions.
• Ensure best practices in code quality, pipeline reliability, and data governance.
• Maintain thorough documentation of processes, tools, and infrastructure.
  
  

Requirements

To be successful in this role, you should meet the following requirements:

• 6+ years of experience in data engineering roles.
• Strong programming skills in Python and PySpark.
• Solid experience in working with Kafka for real-time data processing.
• Proven hands-on experience with GCP data tools and architecture.
• Familiarity with CI/CD, version control (Git), and workflow orchestration tools (Airflow/Composer).
• Strong analytical and problem-solving skills with attention to detail.
  
  

Excellent communication and team collaboration skills

You’ll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSBC Software Development India