1500000 - 2000000 INR - Yearly
Bangalore, Karnataka, India
Information Technology
Full-Time
Workforce Next Pvt Ltd
Overview
Job Title: Big Data Engineer
Experience: 5+ Years
Location: Bengaluru (Hybrid – 2-3 days onsite per week)
Salary: ₹15–22 LPA (Depending on experience and skillset)
Employment Type: Full-Time
About the Role:
We are seeking a skilled and detail-oriented Big Data Engineer with strong expertise in Apache Spark to join our dynamic data team in Bengaluru. This role offers the opportunity to work on large-scale data engineering projects that drive business decisions and innovation across the organization.
Key Responsibilities
- Design and develop scalable data processing solutions using Apache Spark (Core, SQL, Streaming, MLlib).
- Build and optimize robust data pipelines and ETL processes for both structured and unstructured data.
- Collaborate with data scientists, analysts, and software engineers to integrate Spark-based data products into broader systems.
- Ensure data quality, integrity, and security across the data lifecycle.
- Monitor and troubleshoot Spark jobs, and continuously improve performance in production environments.
- Integrate Spark with major cloud platforms such as AWS, Azure, or GCP.
Required Skills and Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- 5+ years of hands-on experience with Apache Spark in large-scale data environments.
- Strong programming proficiency in Scala, Python, or Java (preference for Scala).
- Experience with data storage systems like HDFS, Hive, HBase, S3, etc.
- Solid knowledge of SQL, Kafka, Airflow, and NoSQL databases.
- Understanding of distributed systems and parallel computing principles.
- Exposure to Docker/Kubernetes is a strong plus.
Preferred Qualifications
- Certification in Big Data or Apache Spark (e.g., Databricks Certified Developer).
- Experience working in a DevOps/CI-CD environment.
- Familiarity with data warehousing tools like Snowflake or Redshift.
Job Types: Full-time, Permanent
Pay: ₹1,500,000.00 - ₹2,000,000.00 per year
Schedule:
- Day shift
- Monday to Friday
Ability to commute/relocate:
- Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)
Education:
- Bachelor's (Required)
Experience:
- Big data: 5 years (Required)
- Apache spark: 4 years (Required)
- Python: 4 years (Required)
Work Location: In person
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in