Software Engineer III - AWS Data Engineer

Job Title: Senior AWS Data Engineer

About the Role:

We are seeking an experienced and highly skilled Senior AWS Data Engineer with over 10 years of experience to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles, extensive experience with AWS services, and a proven track record of designing and implementing scalable data solutions.

Key Responsibilities:

• Design and implement robust, scalable, and efficient data pipelines and architectures on AWS.
• Develop data models and schemas to support business intelligence and analytics requirements.
• Utilize AWS services such as S3, Redshift, EMR, Glue, Lambda, and Kinesis to build and optimize data solutions.
• Implement data security and compliance measures using AWS IAM, KMS, and other security services.
• Design and develop ETL processes to ingest, transform, and load data from various sources into data warehouses and lakes.
• Ensure data quality and integrity through validation, cleansing, and transformation processes.
• Optimize data storage and retrieval performance through indexing, partitioning, and other techniques.
• Monitor and troubleshoot data pipelines to ensure high availability and reliability.
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions.
• Provide technical leadership and mentorship to junior data engineers and team members.
• Identify opportunities to automate and streamline data processes for increased efficiency.
Participate in on-call rotations to provide 24/7 support for critical systems and services.

Required Skills and Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Over 10 years of experience in data engineering, with a strong focus on AWS services.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with SQL and NoSQL databases.
• Strong understanding of data warehousing concepts and technologies.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.