Lead Data Engineer-AWS

Job Overview:

UST is seeking a highly experienced Lead Data Engineer with a strong background in AWS and big data technologies. This role is ideal for a seasoned professional with 8–10 years of experience in data engineering, team leadership, and project management. As a Lead AWS Data Engineer, you will be responsible for architecting scalable data solutions, leading engineering teams, and ensuring alignment with business objectives.

Key Responsibilities:

• Provide technical leadership and mentorship to data engineering teams.
• Architect, design, and deploy scalable, secure, and high-performance data pipelines.
• Collaborate with stakeholders, clients, and cross-functional teams to deliver end-to-end data solutions.
• Drive technical strategy and implementation plans in alignment with business needs.
• Oversee project execution using tools like JIRA, ensuring timely delivery and adherence to best practices.
• Implement and maintain CI/CD pipelines and automation tools to streamline development workflows.
• Promote best practices in data engineering and AWS implementations across the team.

Technical Skills:

• Strong hands-on expertise in Python, PySpark, and Spark architecture, including performance tuning and optimization.
• Advanced proficiency in SQL and experience in writing optimized stored procedures.
• In-depth knowledge of the AWS data engineering stack, including:
• AWS Glue
• Lambda
• API Gateway
• EMR
• S3
• Redshift
• Athena
• Experience with Infrastructure as Code (IaC) using CloudFormation and Terraform.
• Familiarity with Unix/Linux scripting and system administration is a plus.
• Proven ability to design and deploy robust, production-grade data solutions.

Experience Level- 7-10 Years

Location- Pune, Bangalore, Chennai, Hyderabad, Gurgaon, Trivandrum, Kochi