AI Engineer

Overview

IBM Systems helps IT leaders think differently about their infrastructure. IBM servers and storage are no longer inanimate - they can understand, reason, and learn so our clients can innovate while avoiding IT issues. Our systems power the world’s most important industries and our clients are the architects of the future. Join us to help build our leading-edge technology portfolio designed for cognitive business and optimized for cloud computing.

Your Role And Responsibilities

A hands-on engineering position responsible for designing, automating, and maintaining robust build systems and deployment pipelines for AI/ML components, with direct development responsibilities in C++ and Python. The role supports both model training infrastructure and high-performance inference systems.

• Design and implement robust build automation systems that support large, distributed AI/C++/Python codebases.
• Develop tools and scripts that enable developers and researchers to rapidly iterate, test, and deploy across diverse environments.
• Integrate C++ components with Python-based AI workflows, ensuring compatibility, performance, and maintainability.
• Lead the creation of portable, reproducible development environments, ensuring parity between development and production.
• Maintain and extend CI/CD pipelines for Linux and z/OS, implementing best practices in automated testing, artifact management, and release validation.
• Collaborate with cross-functional teams — including AI researchers, system architects, and mainframe engineers — to align infrastructure with strategic goals.
• Proactively monitor and improve build performance, automation coverage, and system reliability.
• Contribute to internal documentation, process improvements, and knowledge sharing to scale your impact across teams
  
  

Bachelor's Degree

Required Technical And Professional Expertise

• 5+ years of strong programming skills in C++ and Python, with a deep understanding of both compiled and interpreted language paradigms.
• Hands-on experience building and maintaining complex automation pipelines (CI/CD) using tools like Jenkins, or GitLab CI.
• In-depth experience with build tools and systems such as CMake, Make, Meson, or Ninja, including custom script development and cross-compilation.
• Experience working on multi-platform development, specifically on Linux and IBM z/OS environments, including understanding of their respective toolchains and constraints.
• Experience integrating native C++ code with Python, leveraging pybind11, Cython, or similar tools for high-performance interoperability.
• Proven ability to troubleshoot and resolve build-time, runtime, and integration issues in large-scale, multi-component systems.
• Comfortable with shell scripting (Bash, Zsh, etc.) and system-level operations.
• Familiarity with containerization technologies like Docker for development and deployment environments.
  
  

• Working knowledge of AI/ML frameworks such as PyTorch, TensorFlow, or ONNX, including understanding of how they integrate into production environments.
• Experience developing or maintaining software on IBM z/OS mainframe systems.
• Familiarity with z/OS build and packaging workflows,
• Understanding of system performance tuning, especially in high-throughput compute or I/O environments (e.g., large model training or inference).
• Knowledge of GPU computing and low-level profiling/debugging tools.
• Experience managing long-lifecycle enterprise systems and ensuring compatibility across releases and deployments.
• Background contributing to or maintaining open-source projects in the infrastructure, DevOps, or AI tooling space
• Proficiency in distributed systems, microservice architecture, and REST APIs.
• Experience in collaborating with cross-functional teams to integrate MLOps pipelines with CI/CD tools for continuous integration and deployment, ensuring seamless integration of AI/ML models into production workflows.
• Strong communication skills with the ability to communicate technical concepts effectively to non-technical stakeholders.
• Demonstrated excellence in interpersonal skills, fostering collaboration across diverse teams.
• Proven track record of ensuring compliance with industry best practices and standards in AI engineering.
• Maintained high standards of code quality, performance, and security in AI projects.