Senior Data Engineer

Overview

WHAT YOU’LL DO?

• Optimize query performance through partitioning and indexing strategies
• Create reusable data transformation patterns and components
• Conduct mandatory code reviews and provide constructive feedback
• Establish enterprise-wide data engineering standards and reusable patterns
• Lead quarterly technical debt remediation sprints
• Mentor team on Azure data engineering, PySpark optimization, and best practices
• Conduct pair programming sessions on complex modules
• Lead monthly knowledge-sharing sessions and guide architectural decisions
• Create comprehensive technical documentation, runbooks, and data dictionaries
• Document data lineage, dependencies, and disaster recovery procedures
• Build knowledge base for troubleshooting and operational procedures
• Establish version control standards and deployment workflows
• Implement data classification and sensitivity labeling
• Establish data retention and archival policies
• Build automated data validation frameworks
• Create audit logging and compliance tracking
• Design and implement data quality checks
• Establish proactive monitoring with SLA tracking
• Create dependency mapping for all solutions
• Implement structured incident management with on-call rotation
• Conduct root cause analysis and preventive measures
  
  

WHAT YOU’LL NEED?

• 5+ years Azure data engineering (Databricks, Data Factory, Synapse)
• Strong PySpark – production-quality code, optimization, complex transformations
• Advanced SQL – complex queries, window functions, performance tuning
• Data warehousing – dimensional modeling, SCD, star/snowflake schemas
• Azure DevOps – CI/CD pipelines, repos, infrastructure-as-code
• ERP integration experience (SAP, Dynamics, Oracle or similar)
• API development – REST APIs, integration patterns
• Monitoring & operations – Azure Monitor, incident management, on-call experience
• Quality-focused – writes clean, maintainable, well-documented code
• Problem solver – tackles complex technical challenges with creative solutions
• Mentorship ability – teach complex concepts clearly and patiently
• 24/7 Availability
  
  

WHO YOU ARE?

• Loves building scalable data pipelines and architectures
• Has strong Azure data engineering experience (Databricks, ADF, Synapse)
• Can translate business requirements into technical solutions
• Enjoys mentoring and establishing team standards
• Thrives in wearing multiple hats (architect + developer + mentor)
• Cares deeply about code quality, documentation, and operational excellence