Data Engineer II

hackajob is collaborating with American Express to connect them with exceptional tech professionals for this role.

You Lead the Way. We’ve Got Your Back.

With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create a career journey that’s unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally.

At American Express, you’ll be recognized for your contributions, leadership, and impact—every colleague has the opportunity to share in the company’s success. Together, we’ll win as a team, striving to uphold our company values and powerful backing promise to provide the world’s best customer experience every day. And we’ll do it with the utmost integrity, and in an environment where everyone is seen, heard and feels like they belong.

Join Team Amex and let's lead the way together.

We are building a banking platform that enables teams to create products at scale and powers digital channels to deliver compelling experiences in a dramatically faster fashion.

We look primarily for people who are passionate about solving business problems through innovation and engineering practices. You will be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders daily to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. We welcome diverse perspectives and people who are not afraid to challenge assumptions.

Our mission is to accelerate the pace of financial innovation and build new financial products for American Express. Our platform streamlines the process of launching and iterating financial products.

Responsibilities

• Develops and tests software, including ongoing refactoring of code & drives continuous improvement in code structure & quality.
• Functions as a core member of an Agile team driving User story analysis & elaboration, design and development of software applications, testing & builds automation tools.
• Designs, codes, tests, maintains, and documents data applications.
• Takes part in reviews of own work and reviews of colleagues' work.
• Defines test conditions based on the requirements and specifications provided.
• Partner with the product teams to understand business data requirements, identify data needs and data sources to create data architecture
• Documents data requirements / data stories and maintains data models to ensure flawless integration into existing data architectures
• Leads multiple tasks effectively - progresses work in parallel
• Adapts to change quickly and easily
• Handles problems and acts on own initiative without being prompted
  
  

Qualifications

• Must have demonstrated proficiency and experience in the following tools and technologies:
• Python Object Oriented Programming
• Python Built in libraries: JSON, Base64, logging, os, etc.
• Python: Poetry and dependency management
• Asynchronous Reactive Micro services utilizing Fast API
• Firm foundational understanding of Distributed Storage and Distributed Compute
• Py spark framework: DataFrames (Aggregation, Windowing techniques), Spark SQL
• Cornerstone Data Ingestion Process, Cornerstone Business Metadata management, Interactive Analytics using YellowBrick,
• Hyperdrive JSON schema development, CStreams Realtime event ingestion pipeline using Kafka,
• Event Engine Management
• Test Driven Development
• Must have Banking Domain Knowledge: Money Movement, Zelle, ACH, Intraday
• Working Knowledge of following tools and technologies:
• Data Governance Toolset: Collibra, Manta
• REST APIs Specifications using Swagger
• Development Tool Central, XLR, Jenkins
• Docker Image creation, Containers, PODs
• Hydra Cloud Deployment and Troubleshooting
• Logging using Amex Enterprise Logging Framework
• Analytical and problem-solving skills
• Technical fluency - ability to clearly describe tradeoffs to technical and non- technical audiences alike to help support product decisions.
• Highly organized with strong prioritization skills and outstanding written and verbal communication - you are great at research and documenting your learnings.
• A bachelor's degree.
  

Benefits

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries
• Bonus incentives
• Support for financial-well-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities
  
  

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.