Python Data Engineer IRC267560

Overview

We are seeking a seasoned Python Data Engineer with a strong background in distributed computing and cloud data warehousing. In this role, you will design and build scalable data pipelines that process massive datasets, turning raw data into actionable insights.

As a mid-senior level engineer, you will be expected to architect efficient ETL workflows, optimize data processing scripts, and maintain our core data infrastructure on AWS and Snowflake.

Requirements

Core Languages Expert-level Python (specifically for data engineering patterns).

Data Libraries Advanced proficiency in Pandas, NumPy, and PySpark.

Cloud Platform 2+ years of hands-on experience with AWS services.

Data Warehouse Deep understanding of Snowflake (Snowpipe, Tasks, Streams, and Roles).

SQL Mastery of complex SQL queries and window functions.

Tools & DevOps Experience with Git, Docker, and Airflow (or similar orchestration tools)Technical Skills Required:

Must Have:

• Strong experience in .NET Core / ASP.NET / C#
• Experience with Web API development and Microservices architecture
• Hands-on experience with AWS Cloud services (EC2, Lambda, S3, RDS, SNS, SQS, CloudWatch, etc.)
• Strong understanding of OOPs concepts, Design Patterns, and SOLID principles
• Experience with Entity Framework / LINQ / SQL Server / DynamoDB
• Exposure to CI/CD pipelines and Git-based source control
  
  
  

Good to Have:

• Experience with Docker / Kubernetes
• Familiarity with Serverless applications (AWS Lambda, API Gateway)
• Knowledge of Angular / React / Vue.js (for full-stack roles)
• Basic understanding of Terraform / CloudFormation for infrastructure automation
  
  
  

Job responsibilities

Key Responsibilities

Pipeline Development: Design, develop, and deploy end-to-end ETL/ELT pipelines using Python and PySpark to handle structured and unstructured data.

Data Processing: Utilize Pandas and NumPy for complex data manipulation, statistical analysis, and data validation tasks.

Cloud Architecture: Architect and manage data flows within the AWS ecosystem (S3, Glue, Lambda, EMR).

Data Warehousing: Optimize and manage large-scale data storage and retrieval in Snowflake, ensuring high performance through effective clustering and partitioning.

Performance Optimization: Identify bottlenecks in data processing jobs and refactor code for maximum efficiency and cost-effectiveness.

Code Quality: Maintain high standards of code through unit testing, documentation, and participation in peer code reviews.

What we offer

Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.