Free cookie consent management tool by TermsFeed Senior Data Engineer (Data Quality & Governance Engineer)- Remote, India | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer (Data Quality & Governance Engineer)- Remote, India

decor
Pune, Maharashtra, India
Information Technology
Full-Time
LeewayHertz

Overview

Job Description

This is a remote position.

Job Summary

We are looking for a Senior Data Quality & Governance Engineer who will take ownership of enforcing data contracts, quality, and metadata standards across intelligence and analytics platforms. This role involves designing lineage models, implementing statistical validations, and establishing reusable quality dashboards—all using AWS-native and lightweight open-source tools.

Responsibilities

  • Design and enforce data contracts across Raw → Clean → Modeled zones.
  • Define schema versioning policies, KPI logic, and metadata rules across business-critical datasets.
  • Implement row-level and statistical validations using Great Expectations or Deequ.
  • Create audit-ready QA tables to track failed checks, schema mismatches, and data regressions.
  • Track end-to-end lineage and KPI evolution using OpenMetadata (with Glue/S3/Athena).
  • Auto-classify columns as PII, derived, or forecast-driving fields using AWS Glue Tags/Scripts.
  • Provide CTAS-based Athena queries for building QA dashboards and UAT verifications.
  • Build BI-ready, QA-approved datasets for downstream tools like Superset and Power BI.
  • Establish reusable profiling and validation dashboards for data quality and business teams.
  • Collaborate with engineers, QA, and business SMEs to finalize data validation logic.

Requirements

Essential Skills:

Job

  • Hands-on experience with AWS Glue (Jobs, Crawlers, Catalog), S3, and Athena.
  • Strong foundation in data contracts, quality enforcement, and schema versioning.
  • Expertise in using Deequ or Great Expectations for anomaly detection and data validation.
  • Familiarity with OpenMetadata, Amundsen, or custom metadata tracking solutions.
  • Ability to tag and manage sensitive data fields (e.g., PII, model inputs, derived KPIs).
  • Strong SQL with Athena (CTEs, CTAS, filters, aggregations).
  • Experience building QA dashboards in Superset, Streamlit, or similar BI tools.

Personal

  • Excellent collaboration and communication with QA, architects, and business teams.
  • Self-driven with attention to detail in schema accuracy and metadata enrichment.
  • Ability to translate KPIs and quality rules into validation logic.
  • Proactive in surfacing data regressions and audit issues before they reach production.
  • High ownership mindset with a strong data compliance and governance attitude.

Preferred Skills

Job

  • Implementation of statistical QA techniques like z-score anomalies or entropy thresholds.
  • Experience handling rejected record logs, schema drift validations, and data reconciliation.
  • Awareness of AWS cost optimization techniques in Glue and Athena.

Personal

  • Proactive, ownership-driven mindset with a collaborative approach.
  • Strong communication and collaboration skills.
  • Strong problem-solving skills with attention to detail.
  • Have the ability to work under stringent deadlines and demanding client conditions.
  • Strong analytical and problem-solving skills.
  • Ability to work in fast-paced, delivery-focused environments.
  • Should have strong mentoring and documentation skills.
  • Ability to take end-to-end ownership of QA validation modules.

Other Relevant Information

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Minimum 9+ years of experience in data engineering & architecture.

Benefits

  • This role offers the flexibility of working remotely in India.

LeewayHertz is an equal opportunity employer and does not discriminate based on race, color, religion, sex, age, disability, national origin, sexual orientation, gender identity, or any other protected status. We encourage a diverse range of applicants.

check(event) ; career-website-detail-template-2 => apply(record.id,meta)">
Share job
Similar Jobs
View All
14 Hours ago
Technical Writer| 3-7Years|Pune
Information Technology
  • 1300000 - 1600000 INR - Annual
  • 3 - 7 Yrs
  • Pune
THE POSITION We’re looking for a motivated, driven and collaborative Software Technical Writer that will be an integral member of a small software technical writing team. As a Technical Writer with my client, you will be working with multiple team...
decor
20 Hours ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
21 Hours ago
OIC Lead
Information Technology
  • 7 - 14 Yrs
  • Chennai, Bengaluru
Are you an expert in Oracle Integration Cloud (OIC) with a proven track record of delivering seamless integration solutions. We’re looking for a seasoned OIC Technical consultant with 6 to 10 years of experience and at least 5+ years of hands on expe...
decor
2 Days ago
PHP Developer - Laravel Framework
Information Technology
  • Chennai, Tamil Nadu, India
Company DescriptionQuokka Labs is an AI-native engineering services company, globally recognized for excellence by platforms like Clutch and GoodFirms.We specialize in building scalable, future-ready software solutions tailored to today's fast-evolv...
decor
2 Days ago
.Net Developer - C# Programming
Information Technology
  • Chennai, Tamil Nadu, India
Job Title : Azure .NET DeveloperCompany : Mouri?TechRole : Azure : .NET DeveloperLocation : Hyderabad, Chennai, Bangalore, Vizag (Hybrid)Employment Type : Full?TimeExperience : 69 yearsRole OverviewWere seeking an experienced Azure .NET Develope...
decor
2 Days ago
Senior DevOps Engineer, Trilogy (Remote) - $100,000/year USD
Information Technology
  • 50 - 50 INR - Hourly
  • Chennai, Tamil Nadu, India
Are you ready to transform chaos into order and take control of multi-stack infrastructures?What You Will Be Doing Strategically plan and execute complex infrastructure migrations from legacy systems to a streamlined AWS cloud environment. Innovate ...
decor
2 Days ago
CollegeDekho - Software Engineer - Artificial Intelligence Applications
Information Technology
  • Chennai, Tamil Nadu, India
About The RoleWere looking for a Software Engineer to join our AI team, where we build, deploy, and scale end-to-end AI applications. This role is ideal for someone who has solid experience in Python-based web development and has worked hands-on wit...
decor
2 Days ago
Senior DevOps Engineer, Trilogy (Remote) - $100,000/year USD
Information Technology
  • 50 - 50 INR - Hourly
  • Chennai, Tamil Nadu, India
Are you ready to transform chaos into order and take control of multi-stack infrastructures?What You Will Be Doing Strategically plan and execute complex infrastructure migrations from legacy systems to a streamlined AWS cloud environment. Innovate ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media