Overview
Job Role: Senior Data Engineer - Azure & Big Data
Experience: 7+ years
Job Location: Kochi, Kerala
Job Type: Full-time, Permanent
Notice: Immediate/15 days or currently serving (LWD within 30 days)
Required Skills & Qualifications:
Python & SQL Expertise - Advanced Python (Pandas, NumPy) and strong SQL for building, optimizing, and analyzing large-scale data pipelines.
Big Data & Distributed Systems - Hands-on experience with Apache Spark, Hadoop, and processing TB-scale production datasets.
Cloud & Data Architecture - Strong experience with Azure (preferred) or AWS/GCP, including data lake/lakehouse design and optimization.
ETL/ELT Engineering & Performance - Proven ability in designing scalable ETL/ELT pipelines, performance tuning, and cost optimization.
Data Engineering Best Practices - Knowledge of data modeling, CI/CD & DevOps for data pipelines, data governance, security, and quality management.