Data Engineer

Overview

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and PySpark.
• Optimize and improve data processing workflows for performance and reliability.
• Work with structured and unstructured data to build efficient data models.
• Implement data governance, security, and best practices.
• Collaborate with data analysts and business stakeholders to develop insightful Tableau dashboards and reports.
• Ensure data integrity, consistency, and accuracy across multiple systems.
• Troubleshoot and resolve issues related to data ingestion, transformation, and reporting.
• Work in an agile environment and actively contribute to sprint planning and reviews.

Required Skills and Experience:

• 5-7 years of experience in Data Engineering.
• Strong hands-on expertise with Databricks, PySpark, and Spark.
• Proficiency in writing complex SQL queries for data extraction and transformation.
• Experience with ETL/ELT pipelines, data warehousing, and big data technologies.
• Hands-on experience with Tableau (or other reporting tools) for dashboard creation and data visualization.
• Familiarity with cloud platforms (AWS, Azure, or GCP) and storage solutions.
• Experience with version control systems like Git.
• Strong problem-solving skills and ability to work independently.
• Excellent communication and teamwork skills.

Job Type: Full-time

Pay: ₹1,400,000.00 - ₹1,500,000.00 per year

Benefits:

• Provident Fund

Schedule:

• Day shift

Supplemental Pay:

• Performance bonus

Education:

• Bachelor's (Required)

Experience:

• Databricks: 5 years (Required)
• PySpark & Spark: 5 years (Required)
• Tableau: 5 years (Required)
• ETL/ELT Pipeline: 5 years (Required)
• SQL: 5 years (Required)
• Data Warehousing & Big Data Technologies: 5 years (Required)
• Data Modeling (Structured & Unstructured Data): 5 years (Required)
• Cloud Platforms (AWS, Azure, or GCP): 5 years (Required)
• Data Governance & Security: 5 years (Required)
• Version Control Systems (Git): 5 years (Required)
• Agile Methodologies & Troubleshooting: 5 years (Required)

Language:

• English (Required)

Work Location: In person