Free cookie consent management tool by TermsFeed Senior Data Engineer (Data Quality & Governance Engineer)- Remote, India | Antal Tech Jobs
Back to Jobs
2 Days ago

Senior Data Engineer (Data Quality & Governance Engineer)- Remote, India

decor
Guntur, islas baleares, Spain
Information Technology
Full-Time
LeewayHertz

Overview

Job Description

This is a remote position.

Job Summary

We are looking for a Senior Data Quality & Governance Engineer who will take ownership of enforcing data contracts, quality, and metadata standards across intelligence and analytics platforms. This role involves designing lineage models, implementing statistical validations, and establishing reusable quality dashboards—all using AWS-native and lightweight open-source tools.

Responsibilities

  • Design and enforce data contracts across Raw → Clean → Modeled zones.
  • Define schema versioning policies, KPI logic, and metadata rules across business-critical datasets.
  • Implement row-level and statistical validations using Great Expectations or Deequ.
  • Create audit-ready QA tables to track failed checks, schema mismatches, and data regressions.
  • Track end-to-end lineage and KPI evolution using OpenMetadata (with Glue/S3/Athena).
  • Auto-classify columns as PII, derived, or forecast-driving fields using AWS Glue Tags/Scripts.
  • Provide CTAS-based Athena queries for building QA dashboards and UAT verifications.
  • Build BI-ready, QA-approved datasets for downstream tools like Superset and Power BI.
  • Establish reusable profiling and validation dashboards for data quality and business teams.
  • Collaborate with engineers, QA, and business SMEs to finalize data validation logic.

Requirements

Essential Skills:

Job

  • Hands-on experience with AWS Glue (Jobs, Crawlers, Catalog), S3, and Athena.
  • Strong foundation in data contracts, quality enforcement, and schema versioning.
  • Expertise in using Deequ or Great Expectations for anomaly detection and data validation.
  • Familiarity with OpenMetadata, Amundsen, or custom metadata tracking solutions.
  • Ability to tag and manage sensitive data fields (e.g., PII, model inputs, derived KPIs).
  • Strong SQL with Athena (CTEs, CTAS, filters, aggregations).
  • Experience building QA dashboards in Superset, Streamlit, or similar BI tools.

Personal

  • Excellent collaboration and communication with QA, architects, and business teams.
  • Self-driven with attention to detail in schema accuracy and metadata enrichment.
  • Ability to translate KPIs and quality rules into validation logic.
  • Proactive in surfacing data regressions and audit issues before they reach production.
  • High ownership mindset with a strong data compliance and governance attitude.

Preferred Skills

Job

  • Implementation of statistical QA techniques like z-score anomalies or entropy thresholds.
  • Experience handling rejected record logs, schema drift validations, and data reconciliation.
  • Awareness of AWS cost optimization techniques in Glue and Athena.

Personal

  • Proactive, ownership-driven mindset with a collaborative approach.
  • Strong communication and collaboration skills.
  • Strong problem-solving skills with attention to detail.
  • Have the ability to work under stringent deadlines and demanding client conditions.
  • Strong analytical and problem-solving skills.
  • Ability to work in fast-paced, delivery-focused environments.
  • Should have strong mentoring and documentation skills.
  • Ability to take end-to-end ownership of QA validation modules.

Other Relevant Information

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Minimum 9+ years of experience in data engineering & architecture.

Benefits

  • This role offers the flexibility of working remotely in India.

LeewayHertz is an equal opportunity employer and does not discriminate based on race, color, religion, sex, age, disability, national origin, sexual orientation, gender identity, or any other protected status. We encourage a diverse range of applicants.

check(event) ; career-website-detail-template-2 => apply(record.id,meta)">
Share job
Similar Jobs
View All
1 Day ago
Full Stack Developer in Bangalore
Information Technology
  • Guntur, islas baleares, Spain
As a Full Stack Developer at Skillcurve Careerlabs Private LTD, you will be a key member of our dynamic team, working on cutting-edge projects that push the boundaries of technology. Your expertise in Node.js, JavaScript, and CSS will be vital in cr...
decor
1 Day ago
Full Stack Developer at Cekura (Django + React)
Information Technology
  • Guntur, islas baleares, Spain
About Us\ Cekura is a Y Combinator–backed, early-stage AI startup revolutionizing the testing and observability of AI voice agents. Founded by IIT Bombay alumni, with deep roots in Computer Science (IIT Bombay ’21) and research experience from ETH Z...
decor
1 Day ago
Java Developer
Information Technology
  • Guntur, islas baleares, Spain
About IntugineThe physical goods we consume everyday(think dairy, snacks, furniture, clothing, electronics, automobiles etc.) are sourced, manufactured, stored, and moved across a highly intricate supply chain before they can reach us. The brands th...
decor
1 Day ago
Senior Software Engineer - React JS Node JS
Information Technology
  • Guntur, islas baleares, Spain
Job DescriptionOptum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy b...
decor
1 Day ago
Teamcenter Technical Lead
Information Technology
  • Guntur, islas baleares, Spain
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving r...
decor
1 Day ago
IT Analyst I
Information Technology
  • Guntur, islas baleares, Spain
Job DescriptionJob DescriptionAs a Business Systems Specialist here at Honeywell, you will be responsible for managing and optimizing our business systems to ensure they meet the needs of our organization. Your role will involve analyzing system req...
decor
1 Day ago
DHI Solutions - Full Stack Developer - Java/React.js
Information Technology
  • Guntur, islas baleares, Spain
Job Title : Java Full Stack DeveloperJob SummaryWe are looking for a skilled Full Stack Developer with strong expertise in backend Java development and experience with frontend frameworks like Vue.js (preferred) or React.js. The ideal candidate shou...
decor
1 Day ago
Software Engineer - QA Automation
Information Technology
  • Guntur, islas baleares, Spain
Job DescriptionAgilent inspires and supports discoveries that advance the quality of life. We provide life science, diagnostic, and applied market laboratories worldwide with instruments, services, consumables, applications, and expertise. Agilent e...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media