Senior Software Engineer - Data Engineer with Python, Kafka Streaming & Spark

Position Description

At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve. At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve results for our clients - and for our members. Come grow with us. Learn more at www.cgi.com.

This is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full-time, permanent members start on the first day of employment and include a paid time-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position, however, only candidates selected for interviews will be contacted. No unsolicited agency referrals please.

Job Title: Senior Software Engineer - Java Developer with Kafka Streaming, Spark & OpenShift

Position Title: Senior Software Engineer - Java Developer with Kafka Streaming, Spark & OpenShift

Experience: 6 to 9 Years

Category: Software Development/ Engineering

Main location: Hyderabad

Shift Timings: General Shift

Employment Type: Full Time-Permanent

Position ID: J0225-2078

Your future duties and responsibilities

Job Summary:

• CGI is looking for a skilled and proactive Data Engineer with hands-on experience in Python, Kafka streaming, Apache Spark, and Red Hat OpenShift.
• The ideal candidate will play a key role in designing, developing, and deploying scalable backend systems and real-time data pipelines.
• This position is ideal for someone passionate about building high-performance systems and working with cutting-edge technologies in cloud-native environments.
  
  

Key Responsibilities:

• Develop real-time data streaming applications using Apache Kafka and Kafka Streams.
• Build and optimize large-scale batch and stream processing pipelines with Apache Spark.
• Containerize applications and manage deployments using OpenShift and Kubernetes.
• Collaborate with DevOps teams to ensure CI/CD pipelines are robust and scalable.
• Write unit tests and conduct code reviews to maintain code quality and reliability.
• Work closely with Product and Data Engineering teams to understand requirements and translate them into technical solutions.
• Troubleshoot and debug production issues across multiple environments.
  
  

Required Qualifications To Be Successful In This Role

• Strong programming skills in Java/Python.
• Hands-on experience with Apache Kafka, Kafka Streams, and event-driven architecture.
• Solid knowledge of Apache Spark (batch and streaming).
• Experience with OpenShift, Kubernetes, and container orchestration.
• Familiarity with microservices architecture, RESTful APIs, and distributed systems.
• Experience with build tools such as Maven or Gradle.
• Familiar with Git, Jenkins, CI/CD pipelines, and Agile development practices.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
  
  

Education & Experience:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• Minimum 6 years of experience in backend development with Java and related technologies.
  
  

Preferred Skills (Nice to Have):

• Knowledge of cloud platforms like AWS, Azure, or GCP.
• Understanding of security best practices in cloud-native environments.
• Familiarity with SQL/NoSQL databases (e.g., PostgreSQL, Cassandra, MongoDB).
• Experience with Scala or Python for Spark jobs is a plus.
  
  

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.