Sr. Data Engineer

We are looking for a Senior Data Engineer who can lead the design and development of large-scale data systems on AWS. This role requires someone with strong technical leadership, hands-on experience with modern data architectures, and a proven track record of delivering enterprise-grade data solutions.

Key Responsibilities

• Architect and implement end-to-end data pipelines using AWS cloud-native services.
• Design data lake, lakehouse, and warehouse architectures optimized for performance, scalability, and cost.
• Lead technical design reviews, code reviews, and solution walkthroughs with internal and client teams.
• Collaborate with stakeholders including data scientists, analysts, product owners, and enterprise architects to define data needs.
• Drive best practices in data engineering including testing, versioning, logging, and CI/CD for data pipelines.
• Implement security, data quality, and governance frameworks across data environments.
• Troubleshoot and optimize data workflows in production systems.
• Mentor and guide junior engineers on design, implementation, and delivery standards.
  
  

Requirements

Must-Have Qualifications

• 8 years of experience in data engineering or a similar field.
• Expertise in building batch and real-time data pipelines using AWS services:
• S3, Glue, EMR, Redshift, Athena, Lambda, Dynamo DB, Kinesis, Step Functions, Lake Formation, CloudFormation, Airflow, CodeBuild, IAM Roles
• Strong programming skills in Python and SQL; working knowledge of PySpark or Scala.
• Deep understanding of data modeling, partitioning, and performance tuning.
• Active AWS Certification (e.g., AWS Certified Data Engineer or Solutions Architect – Associate/Professional).
• Strong understanding of data privacy, security, and compliance requirements.
• Experience with orchestration tools (e.g., Airflow, Step Functions) and CI/CD automation.
  
  

Preferred Skills

• Familiarity with Delta Lake, Iceberg, or Apache Hudi.
• Experience with IaC tools such as Terraform or CloudFormation.
• Exposure to multi-cloud or hybrid data architectures (GCP, Azure optional).
• Worked in agile and client-facing consulting environments.
• Prior experience in BFSI or Telco domain preferred.
  
  

Benefits

• Work on cutting-edge data projects across the Asia-Pacific region.
• Fast-track your leadership growth with opportunities to lead client engagements and architect solutions.
• Collaborative culture with a strong focus on technical excellence and continuous learning.
• Flexible work model and competitive compensation.
  
  

We provide a competitive salary and benefits package, a vibrant work environment, and numerous opportunities for professional growth. You'll have the opportunity to work with a team of industry experts on exciting projects that transform businesses and create significant value. Join us to revolutionise the way companies leverage technology for digital transformation.

OnebyZero is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.