Lead Data Engineer

Wissen Technology is Hiring for Lead Data Engineer

About Wissen Technology:

At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset—ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge technology expertise, and a relentless focus on quality. We don’t just meet expectations—we exceed them by ensuring faster time-to-market, reduced rework, and greater alignment with client objectives. We have a proven track record of building mission-critical systems across industries, including financial services, healthcare, retail, manufacturing, and more. Wissen stands apart through its unique delivery models. Our outcome-based projects ensure predictable costs and timelines, while our agile pods provide clients the flexibility to adapt to their evolving business needs. Wissen leverages its thought leadership and technology prowess to drive superior business outcomes. Our success is powered by top-tier talent. Our mission is clear: to be the partner of choice for building world-class custom products that deliver exceptional impact—the first time, every time.

Job Summary: We are seeking a Lead Data Engineer to design and build a modern, cloud-native hybrid transactional and analytical processing (HTAP) data platform using the Microsoft Azure ecosystem, including Microsoft Fabric. The platform will process large volumes of structured and semi-structured data from external entities, apply complex validation logic, and serve both transactional and analytical needs across business functions. This is a high-impact, hands-on leadership role requiring architectural vision, hands-on implementation, and the ability to drive platform standardization at scale

Mode of Work: Full Time

Key Responsibilities:

• Lead the architecture and implementation of an enterprise-grade data platform using Microsoft Fabric and related Azure services
  
  

• Design and implement a Medallion architecture (Bronze/Silver/Gold layers) to manage raw, validated, and curated data
  
  

• Develop real-time data ingestion, validation, and transformation pipelines supporting heterogeneous file formats
  
  

• Build and orchestrate event-driven workflows using serverless Azure Functions, Event Hub, and Durable Functions
  
  

• Integrate Fabric Lakehouses and Synapse Data Warehousing with transactional systems and UI components
  
  

• Implement schema evolution, metadata management, and lineage tracking across the platform
  
  

• Enable business self-service through configurable rules engines and validation UIs
  
  

• Ensure role-based access control (RBAC), end-to-end encryption, and audit trails are enforced across all layers
  
  

• Build CI/CD pipelines and monitoring for automated deployments and observability
  
  

• Collaborate with UI engineers, solution architects, product owners, and compliance stakeholders
  
  

• Lead and mentor a team of data engineers; establish coding and documentation standards
  
  

Requirements:

• 8-12 years of hands-on experience in data engineering, including 3+ years in a leadership or architecture role
  
  

• Strong expertise in Microsoft Azure, especially:
  
  

• Microsoft Fabric (Data Lakehouses, Pipelines, Real-Time Analytics, Synapse)
  
  

• Azure Data Factory, Azure Functions, Event Hub / Service Bus
  
  

• Delta Lake on ADLS Gen2
  
  

• Azure API Management and App Services
  
  

• Advanced knowledge of Python, PySpark, SQL, and workflow orchestration
  
  

• Experience building event-driven, serverless architectures in a production environment
  
  

• Deep understanding of schema-agnostic ingestion, validation logic, and dynamic rule engines
  
  

• Knowledge of data privacy, regulatory compliance, lineage, and auditability
  
  

• Experience integrating with transactional UIs and REST APIs for CRUD operations
  
  

• Proven track record delivering
  

  
  

Preferred Skills:

• Domain knowledge in insurance, financial services, or regulatory systems
  
  

• Familiarity with RE7/FSRI, master data integration, or third-party systems
  
  

• Experience with retention, premium, or commission calculations
  
  

• Prior exposure to Microsoft Purview, Azure Monitor, and Azure Key Vault
  
  

• Understanding of multilingual support, global data residency compliance, and deployment automation
  
  

Wissen Sites: