Senior Data Engineer

Job Summary:

We are seeking a Senior Technical Lead with deep expertise in Azure Databricks, PySpark, and SQL to own the technical delivery and quality of end-to-end solutions in a fast-paced, data-driven environment. The ideal candidate will lead technical teams, define best practices, provide expert consultancy, and work closely with stakeholders to ensure scalable and maintainable solutions aligned with business goals.

Exp- 10-17yrs

Must-Have Skills:

• Azure Databricks
• PySpark
• SQL (Advanced)
• Hands-on experience in end-to-end data pipeline development and deployment.
• Expertise in cloud-native architecture, particularly on Microsoft Azure.
• Strong experience with data modeling, data warehousing, and ETL/ELT pipelines.
• Excellent problem-solving, debugging, and troubleshooting skills.
• Strong understanding of Agile methodologies (Scrum or Kanban).
• Experience with configuration management and unit testing frameworks.

Good-to-Have Skills:

• Working knowledge of Data Lakes, Delta Lake, and big data ecosystems.
• Experience with CI/CD pipelines in a cloud context (e.g., Azure DevOps).
• Familiarity with containerization tools like Docker or Kubernetes.
• Exposure to AI/ML, IoT, or Big Data frameworks.
• Knowledge of domain-specific applications, especially in healthcare or finance.
• Hands-on experience with RDBMS and NoSQL databases.
• Ability to re-engineer existing systems for scalability and performance.