Data Engineer

Overview

Job Description:
We are looking for a Senior Data Integration Engineer to lead the design, implementation, and governance of data pipelines across our factory floor, supply chain, commerce, and finance systems. You will own the full lifecycle of integration, focusing on real-time data streaming, data quality, and scalable architecture that powers both operational processes and advanced analytics, including AI/ML.

Key Responsibilities:

• Design, build, and maintain ELT/ETL pipelines integrating systems like BlueCherry ERP, Manhattan WMS, and Shopify Plus.
• Implement near-real-time, event-driven integrations using Azure Service Bus, Kafka, or Event Hubs.
• Define, version, and publish data contracts and schemas (JSON, Avro) in the enterprise Data Catalog to ensure consistent lineage and governance.
• Develop reconciliation workflows that detect data mismatches, trigger alerts, and monitor SLA compliance.
• Lead integration code reviews and mentor junior engineers, creating reusable playbooks and standardized practices.
• Collaborate with Cybersecurity to embed encryption, PII masking, and compliance controls across data flows.
• Enable AI and analytics pipelines by feeding feature stores and real-time data streams for GenAI and demand forecasting use cases.

Year-One Deliverables:

• Replace legacy nightly CSV file exchange between BlueCherry and WMS with a real-time event-driven system.
• Launch a unified product master API feeding PLM, OMS, and e-commerce within the first 6 months.
• Automate 3-way match reconciliation (PO ↔ Packing List ↔ Warehouse Receipt) to support traceability audits (e.g., BCI cotton).
• Deploy a data quality dashboard with rule-based alerts and SLA tracking.

Required Qualifications:

• 5+ years of experience in data engineering or integration roles.
• Proficiency in at least two of the following: Azure Data Factory, Databricks, Kafka/Event Hubs, DBT, SQL Server, Python, Logic Apps.
• Demonstrated experience integrating ERP, WMS, PLM, or similar systems within a manufacturing or retail environment.
• Strong understanding of data modeling, orchestration, and governance in distributed systems.

FOR IMMEDIATE RESPONSE SEND YOUR UPADATED CV TO: amrit@qapsoftware.com

Job Type: Full-time

Application Question(s):

• How many years of experience you are having in IT ?
• How many years of experience you are having in Data Pipeline ?
• How many years of experience you are having in Apache Kafka ?
• How many years of experienece you are having in AWS ?

Work Location: Remote