Data Platform Architect

Overview

Data Platform Architect

Responsibilities

Key Responsibilities

Architectural Vision & Strategy: Design and own the end-to-end architecture for our data platform,

encompassing data ingestion, processing, storage, and consumption layers.

System Design: Create detailed architectural diagrams, design documents, and technical specifications

for new platform capabilities. Define the standards for how services interact.

Technology Evaluation & Governance: Research, evaluate, and prototype new technologies (e.g.,

table formats, query engines, streaming platforms). Establish and govern technical standards and best

practices across all data engineering teams.

Cross-Functional Leadership: Collaborate with engineering leaders, product managers, data scientists,

and business stakeholders to ensure the platform architecture meets current and future needs. Act as

the key technical advisor for all things data.

Non-Functional Requirements: Drive the strategy for key architectural concerns, including scalability,

security, data governance, performance, and cost optimization.

Prototyping & Frameworks: Develop proof-of-concepts and foundational frameworks that

engineering teams can build upon, ensuring architectural principles are correctly implemented

Requirements

Required Qualifications

10+ years of software engineering experience, with at least 4 years in a dedicated Architect role.

Proven experience designing and architecting large-scale, distributed data systems from the

ground up.

Deep expertise in the modern data stack, including deep knowledge of Apache Spark, Kubernetes,

and object storage systems like MinIO or S3.

Extensive experience with open table formats like Apache Iceberg, Delta Lake, or Hudi, and a

strong understanding of their internal workings.

Demonstrated ability to think strategically, influence without authority, and communicate complex

technical concepts to both technical and non-technical audiences.

Experience creating formal architectural artifacts (e.g., ADRs, design docs, sequence diagrams).

Preferred Qualifications

Experience designing multi-tenant data platforms.

Expertise with interactive MPP query engines like Trino or Presto.

Knowledge of data governance and data cataloging solutions.

Experience with both batch and stream processing architectures (e.g., Kafka, Flink).

Familiarity with Infrastructure as Code (Terraform, Pulumi).