Principal Data Lake Engineer

Overview

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Principal Data Lake Engineer at BairesDev

We are seeking a Principal Data Lake Engineer with deep expertise in data lake architecture, schema-on-read, data governance, and metadata management. The technology stack includes popular open source data lake technologies - Apache Iceberg, Delta Lake, Apache Hudi, and related storage platforms. Thus, there is ample scope for collaboration and contribution to open source. The ideal candidate will lead the design and optimization of scalable data lake systems, drive architectural decisions, and mentor engineering teams while delivering cutting-edge solutions for complex data storage and management challenges.

What You'll Do:

- Contribute actively to data lake and related open source projects as a core contributor.

- Design and optimize data lake architectures for large-scale data storage and processing.

- Architect advanced schema-on-read solutions to enable flexible and efficient data access.

- Lead data governance initiatives to ensure enterprise-level data quality and compliance.

- Drive metadata management system development for comprehensive data discovery and lineage.

- Mentor engineering teams and provide technical leadership across projects.

What we are looking for:

- 10+ years of experience in software development.

- Strong expertise in data lake architectures and large-scale data storage systems.

- Deep understanding of advanced schema-on-read concepts and flexible data modeling.

- Proficiency in enterprise data governance frameworks and compliance management.

- Proven experience with metadata management and large-scale data cataloging systems.

- Core contributions to Apache open source projects (Iceberg, Delta Lake, Hudi, or similar).

- Advanced level of English.

How we make your work (and your life) easier:

- Excellent compensation in USD or your local currency if preferred.

- Paid parental leave, vacation, & national holidays.

- Innovative and multicultural work environment.

- Collaborate and learn from the global Top 1% of talent in each area.

- Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!

Apply now!