Notionmindz Technology - Lead Data Engineer/Data Integration Lead

Lead Data Engineer / Data Integration Lead

Position Type : Full-time

Job Location : Chennai, Tamil Nadu, India

Experience : 8 - 12 Years

About NotionMindz Technology LLP

NotionMindz Technology LLP is a dynamic and innovative technology firm dedicated to delivering cutting-edge solutions to our clients. We specialize in leveraging data to drive insights and business value. We are looking for passionate and experienced professionals to join our growing team.

Job Summary

We are seeking an experienced and highly skilled Lead Data Engineer / Data Integration Lead to spearhead our data initiatives. This pivotal role will be responsible for designing, developing, and leading the implementation of robust data integration solutions, data warehousing operations, and reporting frameworks.

The ideal candidate will possess expert-level knowledge in SQL and RDBMS (specifically SQL Server), strong proficiency in modern ETL/ELT tools like Azure Data Factory and Databricks, and excellent client-facing and team leadership abilities. This role requires a strong understanding of project dynamics and the capacity to translate complex business requirements into tangible data solutions.

Key Responsibilities

Data Architecture & Development :

• Demonstrate expert-level knowledge and hands-on capability in Relational Database Management Systems (RDBMS), particularly SQL Server, including complex SQL query writing, object creation and management, and performance optimization of database/data warehouse operations.
• Possess a strong understanding of Transactional and Dimensional Data Modeling concepts, including Star Schema, Facts, Dimensions, and their relationships.
• Apply a deep understanding of ETL/ELT concepts and possess hands-on exposure to at least one modern ETL/ELT service providing tool such as SSIS, Azure Data Factory (ADF), Azure Databricks, or Airflow.
• Design, build, and optimize scalable data pipelines using Azure Data Factory and Azure Databricks, orchestrating complex data workflows and implementing dynamic and parameterized pipelines.
• Leverage Spark-based data transformations within Databricks for large-scale data integrations, ensuring efficiency and performance.
• Utilize Databricks Unity Catalog for centralized data governance, fine-grained access control, auditing, and secure management of data assets across multiple workspaces.
  
  

Reporting & Data Analysis

• Possess expert-level knowledge in at least one Microsoft reporting/visualization tool, preferably Power BI and/or Azure Analysis Services.
• Perform in-depth data analysis on various reports to troubleshoot missing data, identify data quality issues, and suggest value-added metrics to enhance reporting insights.
• Provide consultative advice to customers on best practices for data visualization and reporting.
  
  

Project Leadership & Client Engagement

• Fully comprehend project context and use-cases, developing a clear personal vision for project execution.
• Act as a primary interface with the customer directly on a daily basis, managing expectations and ensuring clear communication.
• Effectively converse with functional users to elicit and convert business requirements into tangible processes, data models, and comprehensive documentation using available templates.
• Provide proactive and consultative options to customers on the most effective ways to execute projects, guiding them towards optimal solutions.
• Demonstrate a strong understanding of project dynamics, including scoping, setting accurate estimates, defining realistic timelines, and managing exceptions effectively.
  
  

Team Leadership & Quality Assurance

• Technically lead a team of data developers and testers, providing guidance, mentorship, and support.
• Perform thorough design reviews and code reviews to ensure adherence to architectural standards, coding best practices, and performance guidelines.
• Possess the ability to write and review comprehensive test cases, test developed code, and validate data outputs to ensure accuracy and quality.
  
  

SDLC & DevOps Practices

• Possess a good understanding of Software Development Life Cycle (SDLC) practices, including source control, version management, and the usage of Azure DevOps.
• Familiarity with Continuous Integration/Continuous Deployment (CI/CD) practices for automated deployment of data pipelines and solutions.
  
  

Required Qualifications & Skills

• Experience : 8-12+ years of progressive experience in Data Engineering, Data Warehousing, or Data Integration roles, with significant experience in a lead capacity.
• Database Expertise : Expert-level knowledge in RDBMS (SQL Server) and strong SQL query writing, object management, and performance optimization skills.
• Data Modeling : Good understanding of Transactional and Dimensional Data Modeling, Star Schema, Facts/Dimensions, and Relationships.
• ETL/ELT Tools : Strong understanding of ETL concepts and hands-on exposure to SSIS, Azure Data Factory, Azure Databricks, or Airflow.
• Azure Data Platform : In-depth expertise in Azure Data Factory and Azure Databricks, including building scalable data pipelines, workflow orchestration, dynamic pipelines, and Spark-based transformations.
• Data Governance : Hands-on experience with Databricks Unity Catalog for centralized data governance, access control, and data asset management.
• Reporting/Visualization : Expert-level knowledge in Power BI and/or Azure Analysis Services.
• Project Lifecycle : Proven experience in at least one end-to-end ETL project or an end-to-end reporting project (Power BI & Analysis Services preferred).
• SDLC & DevOps : Good understanding of SDLC practices, source control, version management, Azure DevOps, and CI/CD.
• Analytical Skills : Strong data analysis skills for troubleshooting, deriving metrics, and providing insights.
• Leadership : Demonstrated ability to technically lead a team, perform design and code reviews.
• Communication : Excellent presentation and communication skills (written and verbal) to express technical ideas and solutions clearly to both technical and functional audiences.
  
  

Preferred Skills (Bonus Points)

• Knowledge of Python programming language.
• Hands-on experience with Azure DevOps for source control, CI/CD, and project management.
  
  

(ref:hirist.tech)