Senior Data Engineer

Overview

We are seeking a motivated and detail-oriented Data Engineer to join our team. The ideal candidate
will contribute to building, optimizing, and maintaining scalable data pipelines and workflows using
modern cloud platforms and data tools. This role requires a strong foundation in SQL, Python, and
PySpark. Experience with Azure cloud ecosystems is essential. Prior exposure to US healthcare data
or domain knowledge is a plus.
Responsibilities
● Develop, deploy, and manage data pipelines using Databricks, Azure Functions and ADF.
● Collaborate with cross-functional teams to gather and process large datasets, including
healthcare-related data.
● Write efficient Pyspark/SQL queries for data extraction, transformation, and analysis.
● Build and optimize ETL processes and ensure seamless integration of structured and
unstructured data.
● Work on Azure Data Lake(ADLS) or similar platforms for storage and management.
● Implement data transformation tasks using Python and PySpark.
● Ensure data quality, integrity, and security throughout the data lifecycle.
● Monitor and troubleshoot pipeline performance and resolve technical issues promptly.
Qualifications
● Bachelors degree in Computer Science, Information Technology, or a related field.
● 1-3/3-5 years of experience as a Data Engineer I/II or in a similar role.
● Proficiency in Azure Data Factory (ADF) and familiarity with other cloud services
(Azure/AWS).
● Hands-on experience with Pyspark programming for distributed data processing.
● Familiar with T-SQL and relational database systems.
● Exposure to US healthcare data or experience in the healthcare domain is a plus.
● Exposure to CI/CD processes and version control systems like Git is a plus.
● Strong analytical and problem-solving skills.
● Excellent communication and collaboration abilities.
Preferred Skills:
● Hands-on experience with Databricks and Any
Data Warehouse in Cloud.
Must Have Skills
● Pyspark
● Python
● SQL
● Databricks
Why Join Us?
● Opportunity to work with cutting-edge technology and fast growing startup
● Supportive team and a culture of continuous learning and growth.