Free cookie consent management tool by TermsFeed Hadoop Data Engineer/Senior Software Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Hadoop Data Engineer/Senior Software Engineer

decor
Pune, Maharashtra, India
Information Technology
Full-Time
HSBC

Overview

Job Description

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer

In this role you will be

  • Expertise in Scala-Spark/Python-Spark development and should be able to Work with Agile application dev team to implement data strategies.
  • Design and implement scalable data architectures to support the bank's data needs.
  • Develop and maintain ETL (Extract, Transform, Load) processes.
  • Ensure the data infrastructure is reliable, scalable, and secure.
  • Oversee the integration of diverse data sources into a cohesive data platform.
  • Ensure data quality, data governance, and compliance with regulatory requirements.
  • Monitor and optimize data pipeline performance.
  • Troubleshoot and resolve data-related issues promptly.
  • Implement monitoring and alerting systems for data processes.
  • Troubleshoot and resolve technical issues optimizing system performance ensuring reliability.
  • Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team.
  • Implementing and monitoring solutions that identify both system bottlenecks and production issues.

Requirements

To be successful in this role, you should meet the following requirements:

  • Experience in data engineering or related field and hands-on experience of building and maintenance of ETL Data pipelines
  • Good experience in Designing and Developing Spark Applications using Scala or Python.
  • Good experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark)
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Optimization and Performance Tuning of Spark Applications
  • GIT Experience on creating, merging and managing Repos.
  • Perform unit testing and performance testing.
  • Good understanding of ETL processes and data pipeline orchestration tools like Airflow, Control-M.
  • Strong problem-solving skills and ability to work under pressure.
  • Excellent communication and interpersonal skills.

You’ll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSDI
Share job
Similar Jobs
View All
5 Hours ago
Devops Cloud Engineer
Information Technology
  • 3000000 - 3500000 INR - Monthly
  • 7 - 14 Yrs
  • Mumbai
Minimum Experience/Training Required: • At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment • Proven ability to work across structured, semi-structured, and unstructured d...
decor
1 Day ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
1 Day ago
Cybersecurity Engineer
Information Technology
  • 2 - 8 Yrs
  • Anywhere in India/Multiple Locations
Key Responsibilities: Design, implement, and manage Palo Alto Networks solutions, including: Next-Gen Firewall (NGFW) EDR/XDR (Cortex XDR) SIEM/SOAR (Cortex XSIAM) Lead and support migration projects from legacy platforms (e.g., Splunk,...
decor
1 Day ago
Application Developer
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Project Role :Application Developer Must have skills :.Net Full Stack Development Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processe...
decor
1 Day ago
Rosmerta Technologies - Software Java Developer - Spring Boot Framework
Information Technology
  • Pune, Maharashtra, India
Job SummaryWe are seeking a highly experienced and skilled Software Java Developer with a minimum of 8 years of experience to join our dynamic engineering team.The ideal candidate will be a seasoned professional with a strong foundation in Java back...
decor
1 Day ago
Machine Learning Engineer - NLP/Generative AI
Information Technology
  • Pune, Maharashtra, India
About UsWe are a UK-based conveyancing firm dedicated to transforming property transactions through cutting-edge artificial intelligence. We are seeking a talented Machine Learning Engineer with 12 years of experience to join our growing AI team. Th...
decor
1 Day ago
Lead Software Engineer-R-248730
Information Technology
  • Pune, Maharashtra, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
1 Day ago
Software Engineer - Java Full Stack Developer
Information Technology
  • Pune, Maharashtra, India
Job DescriptionAre you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovati...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media