Big Data Engineer

Overview

Job Title: Big Data Engineer
Experience: 5+ Years
Location: Bengaluru (Hybrid – 2-3 days onsite per week)
Salary: ₹15–22 LPA (Depending on experience and skillset)
Employment Type: Full-Time

About the Role:

We are seeking a skilled and detail-oriented Big Data Engineer with strong expertise in Apache Spark to join our dynamic data team in Bengaluru. This role offers the opportunity to work on large-scale data engineering projects that drive business decisions and innovation across the organization.

Key Responsibilities

• Design and develop scalable data processing solutions using Apache Spark (Core, SQL, Streaming, MLlib).
• Build and optimize robust data pipelines and ETL processes for both structured and unstructured data.
• Collaborate with data scientists, analysts, and software engineers to integrate Spark-based data products into broader systems.
• Ensure data quality, integrity, and security across the data lifecycle.
• Monitor and troubleshoot Spark jobs, and continuously improve performance in production environments.
• Integrate Spark with major cloud platforms such as AWS, Azure, or GCP.

Required Skills and Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 5+ years of hands-on experience with Apache Spark in large-scale data environments.
• Strong programming proficiency in Scala, Python, or Java (preference for Scala).
• Experience with data storage systems like HDFS, Hive, HBase, S3, etc.
• Solid knowledge of SQL, Kafka, Airflow, and NoSQL databases.
• Understanding of distributed systems and parallel computing principles.
• Exposure to Docker/Kubernetes is a strong plus.

Preferred Qualifications

• Certification in Big Data or Apache Spark (e.g., Databricks Certified Developer).
• Experience working in a DevOps/CI-CD environment.
• Familiarity with data warehousing tools like Snowflake or Redshift.

Job Types: Full-time, Permanent

Pay: ₹1,500,000.00 - ₹2,000,000.00 per year

Schedule:

• Day shift
• Monday to Friday

Ability to commute/relocate:

• Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)

Education:

• Bachelor's (Required)

Experience:

• Big data: 5 years (Required)
• Apache spark: 4 years (Required)
• Python: 4 years (Required)

Work Location: In person