Senior Data Engineer

Company Overview

At Avahi, we’re redefining what it means to be a premier cloud-first consulting company, recognized for our people, culture, and innovative solutions. With expertise in Managed Services, Reselling, Staffing, and Professional Services, we are dedicated to delivering exceptional value and putting customers first.

As a global team spanning North America, Europe, and Southeast Asia, we foster a collaborative and diverse environment where professional growth, creativity, and mutual respect thrive. Guided by our values—Customer-Centricity, Collaboration, Agility, Innovation, Integrity, and Diversity & Inclusion—we empower businesses to embrace the full potential of a cloud-first approach.

Role Summary

Avahi is seeking an experienced Senior Data Engineer to lead data modernization initiatives and build scalable data solutions for AI/ML applications, including large language models (LLMs) and generative AI. This role focuses on transforming legacy systems into modern cloud architectures, designing robust data pipelines, and enabling data-driven decision-making through cutting-edge solutions.

As a key member of the team, you will collaborate closely with data scientists, DevOps engineers, and solution architects to deliver high-quality data infrastructure that supports Avahi’s innovative projects.

Key Responsibilities 

Data Architecture & Modernization

• Design and implement modern data architectures using AWS services such as Redshift, EMR, Lake Formation, and Glue.
• Lead data migration projects, transitioning legacy systems to cloud-native, scalable solutions.
• Optimize data storage and processing to align with business requirements and technical constraints.

Data Pipelines & AI/ML Support

• Build and optimize data pipelines for AI/ML workloads, including LLMs and generative AI applications.
• Develop code for data ingestion, cleaning, storage, and visualization to support AI/ML projects.
• Design and implement real-time data processing and streaming architectures.

Collaboration & Leadership

• Work closely with data scientists, DevOps engineers, and solution architects to ensure seamless integration and delivery of data solutions.
• Mentor junior team members and share best practices for data engineering and governance.
• Engage stakeholders to design and visually represent technical workflows.

Governance & Security

• Implement data governance and security best practices to ensure compliance and scalability for large datasets.
• Establish frameworks for data quality, testing, and performance monitoring.

Required Skills and Qualifications

• 5+ years of data engineering experience, with at least 3 years working on AWS platforms.
• Proven track record of modernizing data platforms and implementing AI/ML data pipelines.
• Expertise in Python, SQL, and data modeling.
• Proficient in AWS services: Glue, EMR, Redshift, Lake Formation, Athena, Kinesis, S3, EC2, Lambda.
• Strong experience with frameworks and languages like Spark, Hadoop, Python, and ETL/ELT pipelines.
• Skilled in database technologies, including Aurora, DynamoDB, OpenSearch, PostgreSQL, Redshift, and AWS RDS.
• Experience with data governance, security, and scalable architecture for large datasets.
• Strong problem-solving skills and the ability to handle complex tasks independently.
• Excellent communication and stakeholder management skills, including visual design of workflows.
• Ability to work in a fast-paced environment and switch between projects efficiently.

Preferred Qualifications

• AWS Professional certifications.
• Experience with AI/ML frameworks like TensorFlow, PyTorch, or similar tools.
• Knowledge of data quality and testing frameworks.
• Familiarity with infrastructure as code (IaC) tools like Terraform or CloudFormation.
• Experience with ML tools such as feature stores, vector databases, and training data pipelines.

Why Work Here

1. Innovative Culture: 
2. We embrace a startup mindset, encouraging creativity, agility, and growth. Be part of a team that explores cutting-edge technology and drives impactful solutions. 
3. Career Development: 
4. Avahi is committed to your growth, offering mentorship and opportunities to advance your career, with potential for full-time roles after initial contracts. 
5. Purpose-Driven Mission: 
6. Join us in making a difference. Avahi is dedicated to championing diversity, supporting women in tech, and fostering sustainable practices. 
7. Global Collaboration: 
8. Work alongside a diverse, talented team, sharing insights and collaborating to create innovative solutions that make a real impact. 

Join Avahi and make an impact in a fast-paced, customer-focused environment with abundant opportunities for growth.

Accessibility and Inclusivity Statement

At Avahi, we are committed to fostering a workplace that celebrates diversity and inclusivity. We welcome applicants from all backgrounds, experiences, and perspectives, including those from underrepresented communities.

We are proud to be an equal opportunity employer, providing a fair and accessible recruitment process for all candidates. If you require accommodations at any stage of the application or interview process, please let us know, and we will work to meet your needs.