Software Engineer - PySpark, AVP

Join us as a Software Engineer - PySpark

• This is an opportunity for a driven Software Engineer to take on an exciting new career challenge
• Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority
• It’s a chance to hone your existing technical skills and advance your career
• We're offering this role at associate vice president level
  
  

What you'll do

In your new role, you’ll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. You’ll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across the platform.

You’ll Also Be

• Producing complex and critical software rapidly and of high quality which adds value to the business
• Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
• Collaborating to optimise our software engineering capability
• Designing, producing, testing and implementing our working code
• Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operations
  
  

The skills you'll need

You’ll need a background in software engineering, software design, architecture, and an understanding of how your area of expertise supports our customers. You'll need at least nine years of experience in Python or PySpark development preferably in Data and Machine Learning projects. You'll need experience in writing Advance Spark SQL or ANSI SQL queries along with Unix or Linux scripting.

You'll also need experience in Continuous Integration, DevOps, GIT, Artifactory and Airflow. Knowledge of AWS environment will be preferred.

You’ll Also Need

• Experience of working with development and testing tools, bug tracking tools and wikis
• Experience in multiple programming languages or low code toolsets
• Experience of DevOps, Testing and Agile methodology and associated toolsets
• Experience of Spark SQL query optimization and performance tuning
• Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance