Senior Data Engineer II (PySpark, SQL, GCP, Hadoop)

hackajob is collaborating with American Express to connect them with exceptional tech professionals for this role.

You Lead the Way. We’ve Got Your Back.

With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create a career journey that’s unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally.

At American Express, you’ll be recognized for your contributions, leadership, and impact—every colleague has the opportunity to share in the company’s success. Together, we’ll win as a team, striving to uphold our company values and powerful backing promise to provide the world’s best customer experience every day. And we’ll do it with the utmost integrity, and in an environment where everyone is seen, heard and feels like they belong. As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers’ digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills fresh and relevant, we give you dedicated time to invest in your professional development. Find your place in technology on #TeamAmex.

How will you make an impact in this role?

As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers’ digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills fresh and As Senior Engineer Manager you will deliver technical solutions using cutting edge technologies and industry best practices to implement cloud platform. You should have experience in architecting, deploying, automating cloud-based data platforms. You are well versed in technologies such as GCP, Big data, Java, , Spark, Kafka, APIs, Python, SQL, NoSQL etc. You are experienced in building low code/no code data transformation tools using cloud technologies such as GCP/ AWS or Azure. Be part of a fast-paced Agile team, design, develop, test, troubleshoot & optimize solutions created to simplify access to the Amex's Big Data Platform. You will also be responsible for managing the team and projects end to end.

• Preferably a B.Tech or M.Tech degree in computer science, computer engineering, or other technical discipline
• 8+ years of software development experience
• Ability to effectively interpret technical and business objectives and challenges and articulate solutions
• Experience with managing teams and balance multiple priorities.
• Willingness to learn new technologies and exploit them to their optimal potential
• Strong experience with Data in AR, Issues, CARD, Customer, ATM, GL data, International market domain and data understanding and other domains within AMEX
• Strong background with Python, PySpark, Java, Airflow, Spark, PL/SQL
• Cloud experience with GCP would be a preference
• Conduct IT requirements gathering.
• Define problems and provide solution alternatives.
• Create detailed computer system design documentation.
• Implement deployment plan.
• Conduct knowledge transfer with the objective of providing high-quality IT consulting solutions
• Support consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation, design and deployment.
• Under supervision participate in unit-level and organizational initiatives with the objective of providing high-quality and value adding consulting solutions.
• Understand issues and diagnose root-cause of issues. Perform secondary research as instructed by supervisor to assist in strategy and business planning.
• Excellent communication and analytical skills
• Excellent team-player with ability to work with global team
  
  

Minimum Qualifications

• Preferably a B.Tech or M.Tech degree in computer science, computer engineering, or other technical discipline
• 8+ years of software development experience specially in Big Data Engineering
  
  

Preferred Qualifications

• Preferably a B.Tech or M.Tech degree in computer science, computer engineering, or other technical discipline
• 8+ years of software development experience specially in Big Data Engineering
  
  

Benefits

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries
• Bonus incentives
• Support for financial-well-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities
  
  

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.