pyspark development, ETL/ Senior Software Engineer

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer

In this role, you will be:

• Expertise in Python-Spark development and should be able to Work with Agile application dev team to implement data strategies, build data flows.
• Troubleshoot and resolve technical issues optimizing system performance ensuring reliability.
• Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team.
• Take part in process improvements in automation and CI/CD
• Create short-term plans to deliver environments to support sprint-based development.
• Implementing and monitoring solutions that identify both system bottlenecks and production issues.
• Creation of software deployment that allow DevOps engineers to successfully deploy sites/software in any environment.

To be successful in this role, you should meet the following requirements:

• Minimum 3-5 years of hands-on experience of building and maintenance of ETL Data pipelines
• Good experience in Designing and Developing Spark Applications using PySpark.
• Experience on Delta Lake (delta.io) for enterprise grade implementation.
• Optimization and Performance Tuning of Spark Applications
• Proficiency in writing SQL scripts
• Python Programming with different libraries like Pandas, Flask, Tableau API,Postgre
• Experience of Jupyter Notebook, Splunk, Ansible
• GIT Experience on creating, merging and managing Repos.
• Perform unit testing and performance testing.
• Strong communication skills

You’ll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSBC Software Development India