Back to Jobs
3 Days ago
5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Chennai
Ahmedabad, Gujarat, India
Information Technology
Full-Time
UST
Overview
Candidates ready to join immediately can share their details via email for quick processing.
📌 CCTC | ECTC | Notice Period | Location Preference
nitin.patil@ust.com
Act fast for immediate attention! ⏳📩
Candidates ready to join immediately can share their details via email for quick processi
ng.📌 CCTC | ECTC | Notice Period | Location Prefere
ncenitin.patil@ust.
comAct fast for immediate attention!
⏳📩
5+ years if Experie
nce.Roles and Responsibili
- tiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Sca
- la).Build data ingestion and transformation frameworks for structured and unstructured data sour
- ces.Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data soluti
- ons.Work with large volumes of data and ensure quality, integrity, and consiste
- ncy.Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or G
- CP).Implement data quality checks and automation for ETL/ELT pipeli
- nes.Monitor and troubleshoot data issues in production and perform root cause analy
- sis.Document technical processes, system designs, and operational procedu
res.Must-Have Sk
- ills3+ years of experience as a Data Engineer or similar r
- ole.Hands-on experience with PySpark or Spark using Sc
- ala.Strong knowledge of SQL for data querying and transformat
- ion.Experience working with any cloud platform (AWS, Azure, or G
- CP).Solid understanding of data warehousing concepts and big data architect
- ure.Experience with version control systems like
Git.Good-to-Have Sk
- illsExperience with data orchestration tools like Apache Airflow, Databricks Workflows, or simi
- lar.Knowledge of Delta Lake, HDFS, or Ka
- fka.Familiarity with containerization tools (Docker/Kubernet
- es).Exposure to CI/CD practices and DevOps princip
- les.Understanding of data governance, security, and compliance standa
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in