Free cookie consent management tool by TermsFeed Principal Data Engineer | Antal Tech Jobs
Back to Jobs
11 Weeks ago

Principal Data Engineer

decor
Pune, Maharashtra, India
Finance & Banking
Full-Time
Pattern

Overview

Job Description:
Job Summary:
Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams
Key Responsibilities:
Data Pipeline
  • Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS).
  • Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements.
Data Architecture & Query Efficiency
  • Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency.
  • Implement indexing strategies, partitioning, and materialized views to optimize data retrieval.
Collaboration & Governance
  • Partner with data scientists, product managers, and engineers to align data infrastructure with business needs.
  • Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards.
  • Mentor junior engineers and foster best practices in data engineering
Innovation & Leadership
  • Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies.
  • Lead technical strategy for data infrastructure, balancing innovation with operational stability.
Technical Expertise:
  • 8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures.
  • Proficiency in SQL, Python, and tools like Spark and Snowflake.
  • Strong knowledge of database design, dimensional modeling, and query optimization.
Leadership & Collaboration
  • Proven ability to lead teams, mentor engineers, and drive technical initiatives.
  • Experience translating business requirements into scalable technical solutions.
Preferred qualification –
  • Expertise in machine learning model deployment or real-time analytics.
  • Familiarity with DevOps practices (CI/CD, Docker, Kubernetes).
Our Core Values
  • Data Fanatics: Our edge is always found in the data
  • Partner Obsessed: We are obsessed with partner success
  • Team of Doers: We have a bias for action
  • Game Changers: We encourage innovation

Pattern is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Share job
Similar Jobs
View All
15 Hours ago
Software Developer
Information Technology
  • 5 - 10 Yrs
  • Navi Mumbai, Bangalore
About the Role: We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
decor
16 Hours ago
Technical Fullstack Architect
Information Technology
  • 50,00,000 - 60,00,000 INR - Annual
  • 12 - 18 Yrs
  • Hyderabad
About the Role: We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
decor
19 Hours ago
Senior Data Engineer
Information Technology
  • 4 - 8 Yrs
  • Bangalore
City: Address: Bengaluru-Whitefield, Karnataka 560037, IN About Company: Sigmoid is a leading data engineering services and AI consulting company that helps enterprises gain a competitive advantage with effective data-driven decision-making....
decor
2 Days ago
Lead Product Manager- Technical-R-249228
Information Technology
  • Bangalore, Karnataka, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
2 Days ago
PocketPills - Senior Data Analyst - Tableau/Power BI
Information Technology
  • Bangalore, Karnataka, India
About The RoleWe are looking for a dynamic and hands-on Data Analytics & AI professional to join our growing team. The ideal candidate will have a strong foundation in SQL and Python, experience with modern data engineering practices, and the abilit...
decor
2 Days ago
DevOps Engineer - Cloud Infrastructure Management
Information Technology
  • Bangalore, Karnataka, India
Job Description : DevOps EngineerLocation : Gujarat (GIFT City) | Experience : 2-6 years | Type : Full-TimeRole OverviewWe are looking for an experienced DevOps Engineer with 4-6 years of expertise to manage scalable cloud infrastructure, optimize C...
decor
2 Days ago
Lead Software Test Engineer (Automation Tester)-R-249227
Information Technology
  • Bangalore, Karnataka, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
2 Days ago
Interesting Job Opportunity: Vendasta - Senior Software Developer - Full Stack Technologies
Information Technology
  • Bangalore, Karnataka, India
About The JobDevelopers at Vendasta work in teams, working with Product Managers and Designers in the creation of new features and products. Our Research and Development department works hard to help developers learn, grow, and experiment while at w...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media