Data Platform Architect

Overview

This role is responsible for defining and leading the architecture of a comprehensive data platform. It involves setting the strategic vision for data ingestion, processing, storage, and consumption, while ensuring scalability, security, and performance. The position requires

Responsibilities

Key Responsibilities: -

• Architectural Vision & Strategy: Own the overall architecture across data ingestion, processing, storage, and consumption layers.
• System Design: Deliver detailed architectural diagrams, design documents, and technical specifications; set standards for service interactions.
• Technology Evaluation & Governance: Research and prototype emerging technologies; establish and enforce technical standards and best practices.
• Cross-Functional Leadership: Partner with engineering, product, and business stakeholders as the primary technical advisor for all data initiatives.
• Non-Functional Excellence: Drive strategies for scalability, security, data governance, performance, and cost optimization.
• Prototyping & Frameworks: Develop proof-of-concepts and foundational frameworks to accelerate engineering delivery.
  
  
  

• Experience: 10+ years in software engineering, with at least 4 years in a dedicated Architect role.
• Architectural Expertise: Proven track record in designing and architecting large-scale, distributed data systems from the ground up.
• Technical Depth:
• Strong knowledge of the modern data stack, including Apache Spark, Kubernetes, and object storage systems like MinIO or Amazon S3.
• Hands-on experience with open table formats such as Apache Iceberg, Delta Lake, or Hudi, with a deep understanding of their internal workings.
• Leadership & Communication: Ability to think strategically, influence without authority, and clearly communicate complex technical concepts to both technical and non-technical audiences.
• Documentation Skills: Experience creating formal architectural artifacts, including ADRs, design documents, and sequence diagrams.
  
  

Experience designing multi-tenant data platforms.

Expertise with interactive MPP query engines like Trino or Presto.

Knowledge of data governance and data cataloging solutions.

Experience with both batch and stream processing architectures (e.g., Kafka, Flink).

Familiarity with Infrastructure as Code (Terraform, Pulumi).