600000 - 2100000 Indian Rupee - Yearly
Nasik, Maharashtra, India
Information Technology
Full-Time
MDA Edge
Overview
Job Summary
PostgreSQL & Data Modeling:
- We are seeking a results-driven Senior Data Engineer to join our engineering team. The ideal candidate will have hands-on expertise in data pipeline development, cloud infrastructure, and business intelligence (BI) support, with a strong command of the modern data stack.
- In this role, you will be responsible for building scalable ETL/ELT workflows, managing data lakes and marts, and ensuring seamless data delivery to analytics and BI teams. The position requires deep technical proficiency in PostgreSQL, Python scripting, Apache Airflow, AWS (or other cloud environments), and modern data and BI tools.
PostgreSQL & Data Modeling:
- Design and optimize complex SQL queries, stored procedures, and indexes.
- Perform performance tuning and query plan analysis.
- Contribute to schema design and data normalization.
- Migrate data from multiple sources to cloud or operational data store (ODS) platforms.
- Design schema mapping and implement transformation logic.
- Ensure consistency, integrity, and accuracy in migrated data.
- Develop automation scripts for data ingestion, cleansing, and transformation.
- Handle various file formats (JSON, CSV, XML), REST APIs, and cloud SDKs (e.g., Boto3).
- Maintain reusable script modules for operational pipelines.
- Develop and manage Directed Acyclic Graphs (DAGs) for batch and stream workflows.
- Implement retries, task dependencies, notifications, and failure handling.
- Integrate Airflow with cloud services, data lakes, and data warehouses.
- Manage data storage solutions (S3, GCS, Blob), compute services, and data pipelines.
- Configure permissions, IAM roles, encryption, and logging for security.
- Monitor and optimize cost and performance of cloud-based data operations.
- Design and manage data marts using dimensional models.
- Build star and snowflake schemas to support BI and self-service analytics.
- Implement incremental load strategies and partitioning for efficiency.
- Work with tools such as DBT, Fivetran, Redshift, Snowflake, BigQuery, and Kafka.
- Support modular pipeline design and metadata-driven frameworks.
- Ensure high availability and scalability of the data stack.
- Collaborate with BI teams to design datasets and optimize queries.
- Support dashboard development and reporting layers.
- Manage access, data refresh schedules, and performance optimization for BI tools.
- 46 years of hands-on experience in data engineering roles.
- Strong SQL skills in PostgreSQL (query tuning, complex joins, stored procedures).
- Advanced Python scripting skills for automation and ETL processes.
- Proven experience with Apache Airflow (custom DAGs, error handling).
- Solid understanding of cloud architecture, particularly AWS.
- Experience with data marts and dimensional data modeling.
- Exposure to modern data stack tools (DBT, Kafka, Snowflake, etc.).
- Familiarity with BI tools such as Power BI, Apache Superset, or Supertech BI.
- Knowledge of version control (Git) and CI/CD pipelines is a plus.
- Excellent problem-solving and communication skills.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in