Software Engineer III - Pyspark

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorgan Chase within the AI/ML & Data Platform team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.

Job responsibilities

• Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
• Contributes to software engineering communities of practice and events that explore new and emerging technologies
• Adds to team culture of diversity, equity, inclusion, and respect

Required qualifications, capabilities, and skills

• Formal training or certification in Software engineering concepts, with 3+ years of applied experience.
• Hands-on practical experience in in PySpark, Spark SQL, and spark optimization, along with experience in databases and Hadoop technologies
• Deep understanding of data pipelines and proficiency in working with at least one database.
• Experience in building complex distributed systems using Python/Poetry on AWS
• Experience with Python, Kafka, Spark, advanced SQL, Glue
• Technical mentoring experience and strong communication skills.
• Excellent understanding of modern engineering practices to leverage public cloud benefits, such as auto-scaling, with a focus on end-to-end engineering experience supported by tooling and automation.

Preferred qualifications, capabilities, and skills

• Preferred experience in designing, developing, and implementing software solutions, with a commitment to becoming an expert.
• Exposure to cloud technologies, specifically AWS.
• Familiar in Python coding.
• Familiar in PySpark optimization