Free cookie consent management tool by TermsFeed Lead Data Engineer - Big Data & PySpark | Antal Tech Jobs
Back to Jobs
2 Days ago

Lead Data Engineer - Big Data & PySpark

decor
Gurugram, Haryana, India
Information Technology
Full-Time
UST

Overview

Role Description

Key Responsibilities:

  • Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.
  • Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.
  • PySpark Development: Develop and implement efficient ETL processes using PySpark to extract, transform, and load large datasets.
  • Performance Optimization: Optimize PySpark applications for better performance, scalability, and resource management.

Qualifications

  • Proven experience as a Big Data Engineer with a strong focus on PySpark.
  • Deep understanding of Big Data processing frameworks and technologies.
  • Strong proficiency in PySpark for developing and optimizing ETL processes and data transformations.
  • Experience with distributed computing and parallel processing.
  • Ability to collaborate in a fast-paced, innovative environment.

Skills

Big Data, Pyspark

Share job
Similar Jobs
View All
10 Hours ago
Senior Software Developer ( Erlang)
Telecommunications
  • 5 - 8 Yrs
  • Bangalore, Gurgaon / Gurugram
Job Title: SDE-III – Erlang We are seeking an experienced Software Development Engineer – III with strong expertise in Erlang (primary preference), Elixir, or Gleam to help design, build, and optimize high-performance distributed systems for next-...
decor
12 Hours ago
Dot Net Developer
Information Technology
  • 2000000 - 2400000 INR - Annual
  • 6 - 8 Yrs
  • Hyderabad
Role Overview Backend Focus C# / .NET engineering with REST APIs, SQL Server, and multithreading expertise UI Technology WPF strongly preferred, Angular acceptable for candidates willing to adapt Systems Work Windows services, dev...
decor
1 Day ago
RTL Design Engineer
  • 6 - 10 Yrs
  • Bangalore
Summary role description: Hiring RTL Design Engineer for a global leader in electronic design and engineering solutions, empowering innovation in chips and advanced electronic systems. Company description: Our client is a global...
decor
1 Day ago
Junior Software Developer - Fresher
Information Technology
  • 300000 - 500000 INR - Yearly
  • Gurugram, Haryana, India
About the job:Key responsibilities: 1. Write code 2. Test the code 3. Use ChatGPT to generate agents 4. Use GEN AI to create agents that will have information regarding various topicsWho can apply:Only those candidates can apply who:are Computer Sc...
decor
1 Day ago
Shure Inc - Full Stack Developer - AWS
Information Technology
  • Gurugram, Haryana, India
DescriptionAbout the job : Engineer Senior, Cloud Application System Development should design, develop, and maintain application individually as well as work in a group. Should work as per the defined project priorities and project schedules and ens...
decor
1 Day ago
QA Engineer - Noida
Information Technology
  • Gurugram, Haryana, India
Opportunity with TEKsystemsQuality Engineer/QA AnalystTesting on (Automation, Manual, Performance, Regression, Functional)Years of Experience - 1-2 years onlyLocation: Noida (candidates from Noida will only be considered)Work Mode: HybridShift: Gener...
decor
2 Days ago
SAP PP Consultant
Information Technology
  • 10 - 15 Yrs
  • Chennai, Pune
🚀 Exciting Career Opportunity Alert!!! 🚀 Are you a skilled SAP PP/QM/PPDS Consultant with strong design expertise and a passion for building efficient, scalable SAP solutions? Our client, a global leader in enterprise technology and dig...
decor
2 Days ago
Software Engineer II
Information Technology
  • Gurugram, Haryana, India
hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role.Job DescriptionYou’re ready to gain the skills and experience needed to grow within your role and advance your career — and we have the perfe...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media