1buy.ai - Associate Data Architect

Platform Overview

1Buy is a revolutionary platform transforming electronics supply chain through workflows, advanced analytics, pricing intelligence, compliance tracking, and risk management. Our technology integrates global data sources, AI-driven insights, and seamless enterprise connectivity to empower businesses with unparalleled clarity, agility, and decision-making capabilities.

Position Overview

We are hiring a hands-on Data Engineering Lead with 6+ years of experience and a track record of managing at least 2 Data Engineers. You will lead a small team while still writing code, designing pipelines, and owning delivery. Your mission is to deliver clean, timely, lineage-rich data that powers analytics, AI, and customer-facing products.

What Youll Do

• Lead a small data engineering team
• Manage and mentor 23 Data Engineers through clear goals, feedback, and 1:1s
• Hire, onboard, and level up the team with code reviews, pairing, and learning plans
• Own ingestion and integration
• Run source-system analysis and negotiate data contracts with internal and external partners
• Acquire external data with agreed SLAs and quality gates
• Build batch and streaming ingestion with Airflow DAGs, Kafka topics, and Debezium CDC
• Shape models and governance
• Own & evolve schemas and metadata across MongoDB, OpenSearch, and ClickHouse
• Build transformations with dbt and Spark, including SCD Type 2 and incremental CDC models
• Populate OpenSearch and ClickHouse from MongoDB for search and analytics
• Optimize reliability and cost
• Define freshness, completeness, and accuracy SLAs with automated monitoring and alerts
• Cut cost via partitioning, clustering, compression, and tiered storage
• Publish and protect data
• Ship a clear semantic layer and BI artifacts in OpenSearch Dashboards
• Enforce GDPR and DPDP compliance, lineage capture, and role-based access controls
• Run a practical Agile process
• Shape work with Product and Analytics, estimate sanely, and keep delivery predictable
• Drive effective standups, reviews, and retros that improve outcomes
  
  

What Youll Bring

• 7+ years in data engineering or adjacent software roles, with production systems shipped
• Experience managing 2+ Data Engineers while remaining hands-on
• Strong Python skills for pipeline development and tooling
  
  

Proven Work With

• Apache Airflow for orchestration
• Dbt & Great Expectations for ELT and testing
• MongoDB for OLTP and as a primary data store
• Apache Kafka and Debezium for streaming and CDC
• ClickHouse for analytics and OLAP
• OpenSearch for vector, semantic, and full-text search
• Spark for scalable transforms
• AWS for Hosting & Services
• Solid grasp of data modeling, SCD Type 2, CDC, and event-driven designs
• Experience in Agile or scrum environments, with clear communication and pragmatic decision-making
  
  

Nice To Have

• Domain knowledge in Supply Chain or Procurement
• Experience defining and enforcing data contracts with upstream teams
• Privacy and security knowledge, including GDPR and DPDP application
• Infra as code, CI/CD for data, and observability at scale
  
  

How We Work

• Pragmatic Agile. Lightweight ceremonies, strong ownership.
• Code quality over flash. We value readable code, tests, and useful docs.
• Accountability without drama. We surface risks early and fix issues fast.
• Continuous improvement. We measure, learn, and get better every sprint.
  
  

(ref:hirist.tech)