Lead Data Engineer

Position: Lead Data Engineer

Location: Chennai

Work Hours: 12:00 PM – 9:00 PM IST (US Business Hours)

Availability: Immediate

Experience: 8 - 12 Years

About the Company:

Ignitho Inc. is a leading AI and data engineering company with a global presence, including offices in the US, UK, India, and Costa Rica.

Visit our website to learn more about our work and culture: www.ignitho.com.

Ignitho is a portfolio company of Nuivio Ventures Inc., a venture builder dedicated to developing Enterprise AI product companies across various domains, including AI, Data Engineering, and IoT.

Learn more about Nuivio at: www.nuivio.com.

Job Summary

We are looking for a highly skilled Lead Data Engineer to drive the delivery of data warehousing, ETL, and business intelligence solutions. This role involves leading cloud data migrations, building scalable data pipelines, and serving as the primary liaison for client engagements.

Roles & Responsibilities

• Lead end-to-end delivery of data warehousing and BI solutions.
• Act as SPOC for project engagements with cross-functional and international teams.
• Design and implement batch, near real-time, and real-time data pipelines.
• Build scalable data platforms using AWS (Lambda, Glue, Athena, S3).
• Develop and optimise SQL scripts, Python code, and shell scripts for automation.
• Translate business requirements into actionable data insights and reports.
• Manage Agile project execution, ensuring timely and high-quality deliverables.
• Perform root cause analysis, performance tuning, and data profiling.
• Lead legacy data migration to modern cloud platforms.
• Collaborate on data modelling and BI solution design.

Preferred Skills

• Strong Python programming for ETL, APIs, and AWS Lambda.
• Advanced SQL scripting and performance tuning.
• Proficiency in Unix/Linux shell scripting.
• Hands-on experience with AWS services (Lambda, Glue, Athena, S3, CloudWatch).
• Familiarity with GitLab, Bitbucket, or CircleCI.
• Experience in digital marketing data environments is a plus.
• Knowledge of Azure/GCP and tools like Informatica is preferred.
• Exposure to real-time streaming and data lake architectures.

Qualifications

• Bachelor’s degree in computer science, MCA, or related field.
• 8 - 12 years of experience in data engineering and BI.
• At least 5 years of project leadership experience.
• AWS/Data Warehousing certifications are a plus.