Data Engineer( ADF, Databricks, Pyspark)

Overview

Company name: PibyThree consulting Services Pvt Ltd.

Location : Baner, Pune

Start date : ASAP

Job Description :

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Snowflake, and data warehousing concepts. The Data Engineer will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures.

Key Responsibilities:

• Design, develop, and deploy data pipelines using Azure Data Factory (ADF)
• Work with Snowflake to design and implement data warehousing solutions
• Collaborate with cross-functional teams to identify and prioritize data requirements
• Develop and maintain data architectures, data models, and data governance policies
• Ensure data quality, security, and compliance with regulatory requirements
• Optimize data pipelines for performance, scalability, and reliability
• Troubleshoot data pipeline issues and implement fixes
• Stay up-to-date with industry trends and emerging technologies in data engineering

Requirements:

• 4+ years of experience in data engineering, with a focus on cloud-based data platforms (Azure preferred)
• 2+ years of hands-on experience with Azure Data Factory (ADF)
• 1+ year of experience working with Snowflake
• Strong understanding of data warehousing concepts, data modeling, and data governance
• Experience with data pipeline orchestration tools such as Apache Airflow or Azure Databricks
• Proficiency in programming languages such as Python, Java, or C#
• Experience with cloud-based data storage solutions such as Azure Blob Storage or Amazon S3
• Strong problem-solving skills and attention to detail

Job Type: Full-time

Pay: ₹500,000.00 - ₹1,200,000.00 per year

Schedule:

• Day shift

Ability to commute/relocate:

• Pune, Maharashtra: Reliably commute or planning to relocate before starting work (Preferred)

Education:

• Bachelor's (Preferred)

Experience:

• total work: 4 years (Preferred)
• Pyspark: 2 years (Required)
• Azure Data Factory: 2 years (Required)
• Databricks: 2 years (Required)

Work Location: In person