Senior Data Engineer II

You Lead the Way. We’ve Got Your Back.

With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create a career journey that’s unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally.

At American Express, you’ll be recognized for your contributions, leadership, and impact—every colleague has the opportunity to share in the company’s success. Together, we’ll win as a team, striving to uphold our company values and powerful backing promise to provide the world’s best customer experience every day. And we’ll do it with the utmost integrity, and in an environment where everyone is seen, heard and feels like they belong.

Join Team Amex and let's lead the way together.

You will be part of the Operations & QA Engineering team tasked with supporting and maintaining the Information Security (IS) Cyber Analytics data platform and ecosystem consisting of various applications, products and technologies enabling IS teams to better quantify, investigate, and understand risk trends within the American Express (AXP) environment. The data and services provided by the platform help improve visibility to risks and increase the IS teams’ ability to manage the complex and vast data required to support the management and mitigation of AXP security risk.

How will you make an impact in this role?

• Provide Level 2.5 administration for Cloudera Hadoop, Apache NiFi, Elastic index, Logstash, File Beats Kubernetes, and Linux servers
• Provide Level 2.5 administration for Min IO and AWS S3 storage
• Ability to build Kibana dashboards, develop observability solutions for full stack health monitoring
• Understand Redhat repo kickstart process and deploy machines to IT infrastructure and automate basic fulfills through custom scripts. Understand Kubernetes platform architecture
• Write/develop scripts and frameworks using one of the popular languages, like python, shell or Perl to automate regular operational work, to integrate with monitoring tools to monitor applications, systems, ingestions and adhoc requirements
• Work with Ansible and ansible playbooks to automate system management and application work
• Actively participate in troubleshooting and fine-tuning Apache NiFi, Clouder Hadoop parameters to ensure data ingestion needs are fulfilled
• Provide support for regular systems patching, change implementations, maintenance and enhancements to production and Development IT systems
• Proactively respond and work on problem alerts receiving through monitoring tools and other sources
• Be part of on-call rotation with other team players to monitor systems health and proactively engage SMEs to resolve issues on-time. Provide weekend support for production restorations

Minimum Qualifications

• Bachelor’s or master’s degree in computer science, computer engineering or related field or equivalent associate degree.
• Hands on experience with Hortonworks/Cloudera Hadoop administration and Redhat Linux system administration
• Hands on experience with Apache NiFi, Elasticsearch index, Rancher Kubernetes, Min IO, S3 storage administration
• Hands on experience with Kubernetes setup and Ansible automation
• Hands on knowledge to build Kibana dashboards, deploying observability solutions using Prometheus and Grafana
• Strong knowledge and experienced in writing snippets using one the known languages like Shell, Perl, Ruby or Python
• Familiarity with SQL
• Enthusiast to learn and upskill knowledge on open source and community technologies
• Familiarity with monitoring frameworks either open source or Enterprise tools like Icinga2
• Experience in working with onshore/offshore model

Preferred Qualifications

• Cloud Native Kubernetes Certification

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries
• Bonus incentives
• Support for financial-well-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.