Senior Data Engineer

Overview

We are seeking an experienced and highly skilled Senior Data Engineer to join our growing team in Bangalore. The ideal candidate will have a strong background in building and maintaining scalable data pipelines and a passion for working with cutting-edge technologies.

Responsibilities:

• Design, develop, and maintain robust and scalable data pipelines using Python and PySpark.
• Work extensively with AWS services including S3, Athena, and Lambda to manage and process large datasets.
• Develop and optimize data solutions for various data sources, including NoSQL databases like MongoDB.
• Ensure data quality, reliability, and security across all data platforms.
• Collaborate with cross-functional teams to understand data requirements and deliver effective data solutions.
• Troubleshoot and resolve data-related issues.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of hands-on experience as a Data Engineer.
• Proficiency in Python programming for data manipulation and automation.
• Strong experience with PySpark for big data processing.
• Extensive knowledge and practical experience with AWS services, specifically S3, Athena, and Lambda.
• Experience working with SQL databases, particularly MongoDB.
• Solid understanding of data warehousing concepts and ETL/ELT processes.
• Excellent problem-solving and analytical skills.
• Ability to work independently and as part of a team.

Job Type: Full-time

Pay: Up to ₹1,800,000.00 per year

Work Location: In person