Gurugram, Haryana, India
Information Technology
Full-Time
UST
Overview
Role Description
Tech Lead – Azure/Snowflake & AWS Migration
Key Responsibilities
Azure,AWS REDSHIFT,Athena,Azure Data Lake
Tech Lead – Azure/Snowflake & AWS Migration
Key Responsibilities
- Design and develop scalable data pipelines using Snowflake as the primary data platform, integrating with tools like Azure Data Factory, Synapse Analytics, and AWS services.
- Build robust, efficient SQL and Python-based data transformations for cleansing, enrichment, and integration of large-scale datasets.
- Lead migration initiatives from AWS-based data platforms to a Snowflake-centered architecture, including:
- Rebuilding AWS Glue pipelines in Azure Data Factory or using Snowflake-native ELT approaches.
- Migrating EMR Spark jobs to Snowflake SQL or Python-based pipelines.
- Migrating Redshift workloads to Snowflake with schema conversion and performance optimization.
- Transitioning S3-based data lakes (Hudi, Hive) to Snowflake external tables via ADLS Gen2 or Azure Blob Storage.
- Redirecting Kinesis/MSK streaming data to Azure Event Hubs, followed by ingestion into Snowflake using Streams & Tasks or Snowpipe.
- Support database migrations from AWS RDS (Aurora PostgreSQL, MySQL, Oracle) to Snowflake, focusing on schema translation, compatibility handling, and data movement at scale.
- Design modern Snowflake lakehouse-style architectures that incorporate raw, staging, and curated zones, with support for time travel, cloning, zero-copy restore, and data sharing.
- Integrate Azure Functions or Logic Apps with Snowflake for orchestration and trigger-based automation.
- Implement security best practices, including Azure Key Vault integration and Snowflake role-based access control, data masking, and network policies.
- Optimize Snowflake performance and costs using clustering, multi-cluster warehouses, materialized views, and result caching.
- Support CI/CD processes for Snowflake pipelines using Git, Azure DevOps or GitHub Actions, and SQL code versioning.
- Maintain well-documented data engineering workflows, architecture diagrams, and technical documentation to support collaboration and long-term platform maintainability.
- 9+ years of data engineering experience, with 3+ years on Microsoft Azure stack and hands-on Snowflake expertise.
- Proficiency in:
- Python for scripting and ETL orchestration
- SQL for complex data transformation and performance tuning in Snowflake
- Azure Data Factory and Synapse Analytics (SQL Pools)
- Experience in migrating workloads from AWS to Azure/Snowflake, including services such as Glue, EMR, Redshift, Lambda, Kinesis, S3, and MSK.
- Strong understanding of cloud architecture and hybrid data environments across AWS and Azure.
- Hands-on experience with database migration, schema conversion, and tuning in PostgreSQL, MySQL, and Oracle RDS.
- Familiarity with Azure Event Hubs, Logic Apps, and Key Vault.
- Working knowledge of CI/CD, version control (Git), and DevOps principles applied to data engineering workloads.
- Extensive experience with Snowflake Streams, Tasks, Snowpipe, external tables, and data sharing.
- Exposure to MSK-to-Event Hubs migration and streaming data integration into Snowflake.
- Familiarity with Terraform or ARM templates for Infrastructure-as-Code (IaC) in Azure environments.
- Certification such as SnowPro Core, Azure Data Engineer Associate, or equivalent.
Azure,AWS REDSHIFT,Athena,Azure Data Lake
Similar Jobs
View All
1 Day ago
Xpetize - Automation Test Engineer - C#/Selenium
Information Technology
- Gurugram, Haryana, India
Job Title : Automation Test EngineerExperience : 3-6 yearsLocation : Chennai and coimbatoreJob Type : Full-timeJob SummaryWe are seeking a highly skilled Automation Test Engineer with experience in C# and Azure DevOps to join our QA team. The ideal ...
1 Day ago
Frontend CMS Web Developer - AEM Platform
Information Technology
- Gurugram, Haryana, India
NO FRESHER WILL BE PREFERRED. HIRING. We are looking for Frontend CMS Web Developer as an Employee for IT Company. Location Hyderabad. Experience 5+ years.About The RoleWe are seeking a highly skilled Frontend CMS Web Developer to join our dynamic I...
1 Day ago
Full Stack Developer - React.js/Next.js/Golang
Information Technology
- Gurugram, Haryana, India
Position : Full Stack Developer (React/Next js + GoLang) / only backend (GoLang)Experience : 2 - 5 YearsLocation : Rajendra Place- DelhiPosition Type : Full-TimeJob OverviewWe are looking for a skilled Full Stack Developer to design, develop, an...
1 Day ago
Semi Senior Python Developer - Remote Work
Information Technology
- Gurugram, Haryana, India
At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% ...
1 Day ago
Senior .NET Developer - Remote Work
Information Technology
- Gurugram, Haryana, India
At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% ...
1 Day ago
Software Engineer
Information Technology
- Gurugram, Haryana, India
About The JobThe Red Hat Satellite Engineering team is seeking a Software Engineer who is highly motivated and a versatile Python Developer to join our dynamic team in Pune, India. This role offers a unique opportunity to work across both developmen...
1 Day ago
Data Platform Engineer
Information Technology
- Gurugram, Haryana, India
Project Role : Data Platform EngineerProject Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohes...
1 Day ago
Business Analyst
Information Technology
- Gurugram, Haryana, India
Project Role : Business AnalystProject Role Description : Analyze an organization and design its processes and systems, assessing the business model and its integration with technology. Assess current state, identify customer requirements, and defin...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in