Hyderabad, Telangana, India
Information Technology
Full-Time
Zinnov
Overview
Department
Tech
Job posted on
Jul 28, 2025
Employment type
Permanent
Job Summary
We are looking for a highly skilled Big Data & ETL Tester to join our data engineering and analytics team. The ideal candidate will have strong experience in PySpark, SQL, and Python, with a deep understanding of ETL pipelines, data validation, and cloud-based testing on AWS. Familiarity with data visualization tools like Apache Superset or Power BI is a strong plus.
You will work closely with our data engineering team to ensure data availability, consistency, and quality across complex data pipelines, and help transform business requirements into robust data testing frameworks.
Key Responsibilities
- Collaborate with big data engineers to validate data pipelines and ensure data integrity across ingestion, processing, and transformation stages.
- Write complex PySpark and SQL queries to test and validate large-scale datasets.
- Perform ETL testing, covering schema validation, data completeness, accuracy, transformation logic, and performance testing.
- Conduct root cause analysis of data issues using structured debugging approaches.
- Build automated test scripts in Python for regression, smoke, and end-to-end data testing.
- Analyze large datasets to track KPIs and performance metrics supporting business operations and strategic decisions.
- Work with data analysts and business teams to translate business needs into testable data validation frameworks.
- Communicate testing results, insights, and data gaps via reports or dashboards (Superset/Power BI preferred).
- Identify and document areas of improvement in data processes and advocate for automation opportunities.
- Maintain detailed documentation of test plans, test cases, results, and associated dashboards.
Required Skills and Qualifications
- 2+ years of experience in big data testing and ETL testing.
- Strong hands-on skills in PySpark, SQL, and Python.
- Solid experience working with cloud platforms, especially AWS (S3, EMR, Glue, Lambda, Athena, etc.).
- Familiarity with data warehouse and lakehouse architectures.
- Working knowledge of Apache Superset, Power BI, or similar visualization tools.
- Ability to analyze large, complex datasets and provide actionable insights.
- Strong understanding of data modeling concepts, data governance, and quality frameworks.
- Experience with automation frameworks and CI/CD for data validation is a plus.
Preferred Qualifications
- Experience with Airflow, dbt, or other data orchestration tools.
- Familiarity with data cataloging tools (e.g., AWS Glue Data Catalog).
- Prior experience in a product or SaaS-based company with high data volume environments.
Why Join Us?
- Opportunity to work with cutting-edge data stack in a fast-paced environment.
- Collaborate with passionate data professionals driving real business impact.
- Flexible work environment with a focus on learning and innovation.
Similar Jobs
View All
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Technical Writer
Information Technology
- 1300000 - 1600000 INR - Annual
- 3 - 7 Yrs
- Pune
THE POSITION
We’re looking for a motivated, driven and collaborative Software Technical Writer that will be an integral member of a small software technical writing team. As a Technical Writer with my client, you will be working with multiple team...
2 Days ago
Morningstar - Senior Software Engineer - C#/.Net
Information Technology
Job DescriptionTitle : Senior Software EngineerLocation : Vashi, Navi MumbaiCompany : Morningstar is a leading provider of independent investment research in North America, Europe, Australia, and Asia. We offer a wide variety of products and solutio...
2 Days ago
Senior Cloud Engineer/Consultant Specialist
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new...
2 Days ago
Sr. Software Engineer - 10268 - Ruby on Rails
Information Technology
Apply for this JobCoupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data acr...
2 Days ago
Senior Manager, Appian Software Developer
Information Technology
Job DescriptionSenior Manager-Appian Software DeveloperThe Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring missio...
2 Days ago
Junior Scrum Master - Agile Methodologies
Information Technology
- Noida, Uttar Pradesh, India
Job Title: Agile Scrum Executive / Junior Scrum MasterExperience: 13 YearsLocation: Delhi / Gurgaon (On-site / Hybrid depending on company policy)Employment Type: Full-timeRoles And Responsibilities Assist the Scrum Master or Agile Coach in facilit...
2 Days ago
Senior JAVA Developer/Senior Consultant Specialist
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in