Overview
Job Description:
We are looking for a Senior Data Engineer with 6-10 years of experience to design and implement high-performance, scalable, and optimized data solutions. The ideal candidate will have hands-on expertise in Databricks, Apache Spark, and SQL, with a strong grasp of end-to-end data pipeline design and data warehouse implementation.
Key Responsibilities
:Design and propose scalable, end-to-end data pipelines from ingestion to storage and consumption
.
Build and implement data warehouses and data marts for analytics and operational purpose
s.
Execute design implementations, including development, operationalization, and maintenan
ce.
Perform database design, logical and physical data modelling at macro and micro lev
els.
Conduct database performance tuning and manage the data lifec
ycle.
Support and enhance existing data pipelines and database sy
stems.
Required Skills & Qualific
ations:6–10 years of experience in data engineering or data integ
ration.
3+ years of experience with Apache Spark (preferably in a Databricks envir
onment).
2+ years of hands-on experience using Da
tabricks.
Strong experience in PySpark, Python
, and SQL.
Expertise in data modelling, data warehousing, and database te
chnologies.
Experience with ETL/ELT tools (SSIS
or others).
Experience with cloud platforms (AWS or Azure) and big data technologies (e.g., Ha
doop, Spark).
Solid knowledge of SQL query tuning and database performance
optimization.
Ability to implement and follow best practices for performance and maintainability in data-ce
ntric project
s.
Nice to Have:Exposure to AWS native solutions like Redshift, RD
S, S3 is a plus.
Familiarity with IaaS and PaaS solutions in the clou