Free cookie consent management tool by TermsFeed 5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Chennai | Antal Tech Jobs
Back to Jobs
3 Days ago

5+ YoE - Data Engineer – PySpark/Spark Scala with Cloud & SQL - Immediate Joiner - Chennai

decor
Ahmedabad, Gujarat, India
Information Technology
Full-Time
UST

Overview

Candidates ready to join immediately can share their details via email for quick processing.

📌 CCTC | ECTC | Notice Period | Location Preference

nitin.patil@ust.com

Act fast for immediate attention! ⏳📩




Candidates ready to join immediately can share their details via email for quick processi

ng.📌 CCTC | ECTC | Notice Period | Location Prefere

ncenitin.patil@ust.

comAct fast for immediate attention!

⏳📩
5+ years if Experie

nce.Roles and Responsibili

  • tiesDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Sca
  • la).Build data ingestion and transformation frameworks for structured and unstructured data sour
  • ces.Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data soluti
  • ons.Work with large volumes of data and ensure quality, integrity, and consiste
  • ncy.Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or G
  • CP).Implement data quality checks and automation for ETL/ELT pipeli
  • nes.Monitor and troubleshoot data issues in production and perform root cause analy
  • sis.Document technical processes, system designs, and operational procedu

res.Must-Have Sk

  • ills3+ years of experience as a Data Engineer or similar r
  • ole.Hands-on experience with PySpark or Spark using Sc
  • ala.Strong knowledge of SQL for data querying and transformat
  • ion.Experience working with any cloud platform (AWS, Azure, or G
  • CP).Solid understanding of data warehousing concepts and big data architect
  • ure.Experience with version control systems like

Git.Good-to-Have Sk

  • illsExperience with data orchestration tools like Apache Airflow, Databricks Workflows, or simi
  • lar.Knowledge of Delta Lake, HDFS, or Ka
  • fka.Familiarity with containerization tools (Docker/Kubernet
  • es).Exposure to CI/CD practices and DevOps princip
  • les.Understanding of data governance, security, and compliance standa
rds.
Share job
Similar Jobs
View All
1 Day ago
Head of AI Cybersecurity
Information Technology
  • 8 - 13 Yrs
  • Chennai, Mumbai (All Areas)
Location: Mumbai & Chennai- Hybrid (1 week WFO in a month) | Experience: 8+ years Type: Full-time Seeking a visionary and hands-on Head of AI Cybersecurity to lead the end-to-end security of AI/ML systems. This role will drive strategy, implement...
decor
1 Day ago
Intern-AI Engineer
Finance & Banking
  • Pune, Maharashtra, India
Scopely is looking for an Intern - AI Engineer to join our Gen AI team in Bangalore!At Scopely, we care deeply about what we do and want to inspire play, every day - whether in our work environments alongside our talented colleagues, or through our ...
decor
1 Day ago
Software Developer - PHP/Laravel
Finance & Banking
  • Pune, Maharashtra, India
Software Developer (Laravel/PHP)Location : MumbaiWorking Mode : On-siteExperience : 1-5 YearsAbout The RoleKey Responsibilities : Collaborate with cross-functional teams to understand project requirements, define scope, and determine best practices...
decor
1 Day ago
GenAI Data Scientist - Manager
Finance & Banking
  • Pune, Maharashtra, India
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data...
decor
1 Day ago
Java Developer - C11
Finance & Banking
  • Pune, Maharashtra, India
The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technolo...
decor
1 Day ago
Trademo - Lead Data/AI Engineer
Finance & Banking
  • Pune, Maharashtra, India
About TrademoAt Trademo, we are transforming global trade and supply chains by leveraging cutting-edge AI technology to provide businesses with unparalleled visibility, compliance, and intelligence solutions.Our AI-driven platform simplifies the com...
decor
1 Day ago
Senior Web Developer- C11 - CHENNAI
Finance & Banking
  • Pune, Maharashtra, India
The Digital S/W Engineer Intmd Analyst is a developing professional role. Deals with most problems independently and has some latitude to solve complex problems. Integrates in-depth specialty area knowledge with a solid understanding of industry sta...
decor
1 Day ago
GenAI Data Scientist - Manager
Finance & Banking
  • Pune, Maharashtra, India
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media