Free cookie consent management tool by TermsFeed Big Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Big Data Engineer

decor
1500000 - 2000000 INR - Yearly
Bangalore, Karnataka, India
Information Technology
Full-Time
Workforce Next Pvt Ltd

Overview

Job Title: Big Data Engineer
Experience: 5+ Years
Location: Bengaluru (Hybrid – 2-3 days onsite per week)
Salary: ₹15–22 LPA (Depending on experience and skillset)
Employment Type: Full-Time

About the Role:

We are seeking a skilled and detail-oriented Big Data Engineer with strong expertise in Apache Spark to join our dynamic data team in Bengaluru. This role offers the opportunity to work on large-scale data engineering projects that drive business decisions and innovation across the organization.

Key Responsibilities

  • Design and develop scalable data processing solutions using Apache Spark (Core, SQL, Streaming, MLlib).
  • Build and optimize robust data pipelines and ETL processes for both structured and unstructured data.
  • Collaborate with data scientists, analysts, and software engineers to integrate Spark-based data products into broader systems.
  • Ensure data quality, integrity, and security across the data lifecycle.
  • Monitor and troubleshoot Spark jobs, and continuously improve performance in production environments.
  • Integrate Spark with major cloud platforms such as AWS, Azure, or GCP.

Required Skills and Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 5+ years of hands-on experience with Apache Spark in large-scale data environments.
  • Strong programming proficiency in Scala, Python, or Java (preference for Scala).
  • Experience with data storage systems like HDFS, Hive, HBase, S3, etc.
  • Solid knowledge of SQL, Kafka, Airflow, and NoSQL databases.
  • Understanding of distributed systems and parallel computing principles.
  • Exposure to Docker/Kubernetes is a strong plus.

Preferred Qualifications

  • Certification in Big Data or Apache Spark (e.g., Databricks Certified Developer).
  • Experience working in a DevOps/CI-CD environment.
  • Familiarity with data warehousing tools like Snowflake or Redshift.

Job Types: Full-time, Permanent

Pay: ₹1,500,000.00 - ₹2,000,000.00 per year

Schedule:

  • Day shift
  • Monday to Friday

Ability to commute/relocate:

  • Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)

Education:

  • Bachelor's (Required)

Experience:

  • Big data: 5 years (Required)
  • Apache spark: 4 years (Required)
  • Python: 4 years (Required)

Work Location: In person

Share job
Similar Jobs
View All
5 Hours ago
Devops Cloud Engineer
Information Technology
  • 3000000 - 3500000 INR - Monthly
  • 7 - 14 Yrs
  • Mumbai
Minimum Experience/Training Required: • At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment • Proven ability to work across structured, semi-structured, and unstructured d...
decor
1 Day ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
1 Day ago
Cybersecurity Engineer
Information Technology
  • 2 - 8 Yrs
  • Anywhere in India/Multiple Locations
Key Responsibilities: Design, implement, and manage Palo Alto Networks solutions, including: Next-Gen Firewall (NGFW) EDR/XDR (Cortex XDR) SIEM/SOAR (Cortex XSIAM) Lead and support migration projects from legacy platforms (e.g., Splunk,...
decor
1 Day ago
Application Developer
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Project Role :Application Developer Must have skills :.Net Full Stack Development Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processe...
decor
1 Day ago
Rosmerta Technologies - Software Java Developer - Spring Boot Framework
Information Technology
  • Pune, Maharashtra, India
Job SummaryWe are seeking a highly experienced and skilled Software Java Developer with a minimum of 8 years of experience to join our dynamic engineering team.The ideal candidate will be a seasoned professional with a strong foundation in Java back...
decor
1 Day ago
Machine Learning Engineer - NLP/Generative AI
Information Technology
  • Pune, Maharashtra, India
About UsWe are a UK-based conveyancing firm dedicated to transforming property transactions through cutting-edge artificial intelligence. We are seeking a talented Machine Learning Engineer with 12 years of experience to join our growing AI team. Th...
decor
1 Day ago
Lead Software Engineer-R-248730
Information Technology
  • Pune, Maharashtra, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
1 Day ago
Software Engineer - Java Full Stack Developer
Information Technology
  • Pune, Maharashtra, India
Job DescriptionAre you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovati...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media