Senior Data Engineer

Overview

Silver/Gold Layer Development - Translate raw data from sources (Zuora, CommerceTools, APIs, legacy databases) into curated Silver and Gold tables. - Apply business logic, standardization, and data quality checks.

Partner with analysts and business stakeholders to validate metric definitions.

Replatforming Support - Audit existing pipelines for dependencies on legacy data structures.

Update models and jobs to consume data from new transactional systems.

Ensure lineage tracking and compatibility with downstream reporting and analytics.

Collaboration & Documentation - Work closely with engineers, analysts, and business partners to document requirements, transformations, and validations.

Contribute to metadata tagging and data cataloging (Unity Catalog).

Deliver detailed documentation including data dictionaries, constraints (PK, FK), and pipeline logic.

Must-Have Qualifications

Strong data modeling skills (Kimball methodology) with hands-on Databricks experience.

Proficiency in SQL and Python.

Expertise with Databricks features such as workflows, DLTs, Delta tables, and Unity Catalog.

Familiarity with Medallion Architecture (Bronze/Silver/Gold layers).

Experience with version control systems (GitHub).

Solid understanding of data governance, data quality frameworks, and observability practices.

Ability to work effectively across analytics, product, and engineering teams.