Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer

decor
600000 - 2100000 Indian Rupee - Yearly
Nasik, Maharashtra, India
Information Technology
Full-Time
MDA Edge

Overview

Job Summary

  • We are seeking a results-driven Senior Data Engineer to join our engineering team. The ideal candidate will have hands-on expertise in data pipeline development, cloud infrastructure, and business intelligence (BI) support, with a strong command of the modern data stack.
  • In this role, you will be responsible for building scalable ETL/ELT workflows, managing data lakes and marts, and ensuring seamless data delivery to analytics and BI teams. The position requires deep technical proficiency in PostgreSQL, Python scripting, Apache Airflow, AWS (or other cloud environments), and modern data and BI tools.

Key Responsibilities

PostgreSQL & Data Modeling:

  • Design and optimize complex SQL queries, stored procedures, and indexes.
  • Perform performance tuning and query plan analysis.
  • Contribute to schema design and data normalization.

Data Migration & Transformation

  • Migrate data from multiple sources to cloud or operational data store (ODS) platforms.
  • Design schema mapping and implement transformation logic.
  • Ensure consistency, integrity, and accuracy in migrated data.

Python Scripting For Data Engineering

  • Develop automation scripts for data ingestion, cleansing, and transformation.
  • Handle various file formats (JSON, CSV, XML), REST APIs, and cloud SDKs (e.g., Boto3).
  • Maintain reusable script modules for operational pipelines.

Data Orchestration With Apache Airflow

  • Develop and manage Directed Acyclic Graphs (DAGs) for batch and stream workflows.
  • Implement retries, task dependencies, notifications, and failure handling.
  • Integrate Airflow with cloud services, data lakes, and data warehouses.

Cloud Platforms (AWS / Azure / GCP)

  • Manage data storage solutions (S3, GCS, Blob), compute services, and data pipelines.
  • Configure permissions, IAM roles, encryption, and logging for security.
  • Monitor and optimize cost and performance of cloud-based data operations.

Data Marts & Analytics Layer

  • Design and manage data marts using dimensional models.
  • Build star and snowflake schemas to support BI and self-service analytics.
  • Implement incremental load strategies and partitioning for efficiency.

Modern Data Stack Integration

  • Work with tools such as DBT, Fivetran, Redshift, Snowflake, BigQuery, and Kafka.
  • Support modular pipeline design and metadata-driven frameworks.
  • Ensure high availability and scalability of the data stack.

BI & Reporting Tools (Power BI / Superset / Supertech):

  • Collaborate with BI teams to design datasets and optimize queries.
  • Support dashboard development and reporting layers.
  • Manage access, data refresh schedules, and performance optimization for BI tools.

Required Skills & Qualifications

  • 46 years of hands-on experience in data engineering roles.
  • Strong SQL skills in PostgreSQL (query tuning, complex joins, stored procedures).
  • Advanced Python scripting skills for automation and ETL processes.
  • Proven experience with Apache Airflow (custom DAGs, error handling).
  • Solid understanding of cloud architecture, particularly AWS.
  • Experience with data marts and dimensional data modeling.
  • Exposure to modern data stack tools (DBT, Kafka, Snowflake, etc.).
  • Familiarity with BI tools such as Power BI, Apache Superset, or Supertech BI.
  • Knowledge of version control (Git) and CI/CD pipelines is a plus.
  • Excellent problem-solving and communication skills.
Share job
Similar Jobs
View All
1 Day ago
Frontend Developer - Remote
Information Technology
  • 1 - 7 Yrs
  • Anywhere in India/Multiple Locations
Location: Remote (India only) Experience: 1+ Years Job Type: Full-Time Salary: Competitive (based on experience)   About the Role We’re hiring a Frontend Developer with 1+ years of experience to join our remote team. You’ll build responsi...
decor
2 Days ago
Junior Software Developer in Anakapalli
Information Technology
Key Responsibilities Design and implement IoT solutions Develop IoT applications and systems Integrate IoT devices with existing systems Analyze data from IoT devices for insights Collaborate with cross-functional teams Join our team and be pa...
decor
2 Days ago
Senior Talent Acquisition Specialist – Tech Hiring
Information Technology
  • 5 - 12 Yrs
  • Bangalore, Mumbai (All Areas), Hyderabad, Pune
Position: Senior Talent Acquisition Specialist – Tech Hiring Experience Required: 5+ years Location: Mumbai, Pune, Bangalore, Hyderabad (Hybrid) Industry: Technology, IT Services, Product Companies We’re looking for an experienced Talent Ac...
decor
2 Days ago
Senior Vice President of Engineering
Information Technology
  • 12 - 16 Yrs
  • India
We are hiring a Senior Vice President (SVP) of Engineering for a high-growth, innovation-led cybersecurity company specializing in AI-powered security solutions. The company secures over 500 million+ devices, is backed by top-tier investors, and is t...
decor
3 Days ago
Senior Software Engineer-R-252016
Information Technology
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
3 Days ago
Software Engineer - Intermediate
Information Technology
  • Bangalore, Karnataka, India
As passionate about our people as we are about our mission. What We’re All About: Q2 is proud of delivering our mobile banking platform and technology solutions, globally, to more than 22 million end users across our 1,300 financial institutions and ...
decor
3 Days ago
Software Engineer- DevOps and Azure Cloud
Information Technology
  • Nasik, Maharashtra, India
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data a...
decor
3 Days ago
Senior DevOps Engineer
Information Technology
Job description We are seeking a highly skilled DevOps Engineer to join our dynamic DevOps team. The ideal candidate will have a strong background in Python programming and a passion for enhancing our DevOps processes. Your expertise will be crucial...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media