Lead Software Engineer

Job Summary:

We are seeking a highly skilled and experienced Big Data & AWS Engineer to join our Data Engineering team. This role requires a deep understanding of big data technologies and cloud-based data solutions, with a strong focus on the AWS ecosystem. You will be responsible for designing and building scalable data pipelines and analytics platforms to support Business Intelligence and Data Science initiatives across the organization.

Key Responsibilities

• :Design and implement scalable big data solutions using AWS services such as S3, Redshift, EMR, Glue, Kinesis, Athena, and Lambda
• .Build and maintain robust ETL/ELT pipelines for processing structured and unstructured data
• .Collaborate with data scientists, analysts, and stakeholders to gather requirements and deliver data-driven insights
• .Optimize data processing and storage solutions for performance and cost-efficiency
• .Ensure data security, compliance, and governance in alignment with organizational policies
• .Monitor and troubleshoot data workflows and infrastructure for high availability and reliability
• .Stay up to date with emerging trends and best practices in big data and cloud technologies
• .Mentor junior engineers and participate in architectural planning and decision-making

.Required Skills & Qualification

• s:Bachelor’s or Master’s degree in Computer Science, Engineering, or a related fiel
• d.5+ years of experience in big data engineering and cloud-based data platform
• s.Proficiency in Hadoop, Apache Spark, Kafka, and data warehousing concept
• s.Strong programming skills in Python, Scala, or Jav
• a.Hands-on experience with AWS data services, includin
• g:Amazon Redshi
• ftAWS Gl
• ueAmazon E
• MRAmazon
• S3AWS Lamb
• daExperience wit
• h:Data lakes, data modeling, and real-time data processi
• ngInfrastructure as Code (e.g., Terraform, CloudFormatio
• n)DevOps practices and CI/CD pipelin
• esStrong analytical, problem-solving, and communication skill

s.Preferred Tools & Technologi

• es:Big Data: Hadoop, Spark, Ka
• fkaAWS Services: Redshift, S3, Glue, EMR, Lambda, Kinesis, Ath
• enaProgramming: Python, Scala, J
• avaDevOps & IaC: Terraform, CloudFormation, CI/CD to
• olsData Architecture: ETL/ELT, Data Lakes, Real-time process