Senior Data Engineer

Overview

Profile: Data Engineer

Skills: AWS Glue, Spark, PySpark, SQL

Experience - 7+ Years

Time- 3 Hrs Per Day (Between 6 PM IST to 1 AM IST)

Location: Remote

Job Summary:

We are seeking a highly skilled and proactive Data Engineer with hands-on experience in building and maintaining data pipelines on AWS. The ideal candidate should have strong expertise in SQL, PySpark, and cloud technologies, particularly AWS Glue, Athena, and SageMaker. You will play a key role in designing, developing, and optimizing large-scale data pipelines and working collaboratively with data scientists, analysts, and cross-functional teams.

Key Responsibilities:

• Design, build, and manage scalable and reliable data pipelines using AWS Glue, Spark, and PySpark
• Write optimized, complex SQL queries to transform and prepare datasets for analytical and operational use
• Work with Hive and Athena for querying and managing big data on AWS
• Integrate data from various sources and ensure high data quality and governance
• Collaborate with data scientists to support ML model development and deployment using AWS SageMaker
• Manage code and version control using GitHub; document processes in Confluence
• Utilize VS Code or similar IDEs for development and debugging
• Ensure data security, compliance, and best practices in all pipeline and ETL processes
• Monitor pipeline performance and resolve production issues in a timely manner

Required Skills:

• Strong proficiency in SQL (including complex joins, window functions, and optimizations)
• Deep understanding and hands-on experience with AWS services:
• AWS Glue, S3, Athena, SageMaker
• Programming knowledge in Python and PySpark
• Experience working with Apache Spark and Hive
• Familiarity with GitHub for version control and Confluence for documentation
• Comfort using Visual Studio Code (VSCode) for development work
• Good understanding of data modeling, ETL best practices, and data quality frameworks

Job Types: Part-time, Contractual / Temporary, Freelance
Contract length: 6 months

Pay: From ₹30,000.00 per month

Expected hours: 15 – 20 per week

Benefits:

• Work from home

Schedule:

• Evening shift
• Fixed shift
• Monday to Friday

Experience:

• SQL: 3 years (Required)
• Data engineer: 7 years (Required)
• AWS: 3 years (Required)

Work Location: Remote