Big Data Engineer

Overview

Job Title: Big Data Engineer

Experience: 5-7 yrs

Location: Bangalore
Mode : Hybrid

Job Summary:

We are seeking a skilled and experienced Big Data Engineer to join our data engineering

team. The ideal candidate will be responsible for designing, developing, and optimizing

scalable data pipelines, implementing robust ETL processes, and managing the integration

and performance of our big data ecosystem. You will work with cutting-edge technologies to transform large volumes of structured and unstructured data into actionable insights.

Key Responsibilities:

• Design, implement, and optimize scalable, end-to-end data pipelines for ingesting, processing, and transforming large datasets.
• Develop robust ETL (Extract, Transform, Load) processes to integrate data from various structured and unstructured sources.
• Troubleshoot and resolve data-related issues through in-depth data analysis and validation techniques.
• Implement and manage data workflows and ETL processes in a production environment.
• Monitor system performance and recommend necessary infrastructure or configuration changes to ensure efficiency and scalability. Required Skills & Qualifications:
• Proven experience in Big Data engineering and analytics.
• Strong understanding of distributed computing principles.
• Proficiency in Big Data technologies including Hadoop, HDFS, MapReduce.
• Hands-on experience with Spark, PySpark, and Python.
• Solid knowledge of Big Data querying tools such as Pig, Hive, and SparkSQL.
• Experience with GCP and related Big Data services is highly preferred.
• Expertise in integrating data from multiple data sources and systems.
• Experience working with NoSQL databases like HBase, Cassandra, and MongoDB.
• Familiarity with enterprise Big Data platforms such as Cloudera or MapR.

Preferred Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
• Experience working in a CI/CD environment.

Job Type: Full-time

Pay: ₹1,500,000.00 - ₹1,900,000.00 per year

Benefits:

• Paid sick time
• Provident Fund
• Work from home

Schedule:

• Day shift
• Fixed shift

Application Question(s):

• What is your Notice Period?
• What's your current CTC?
• Do you have the experience in Banking and Finance Domain ?

Experience:

• Big Data Engineer: 5 years (Required)
• Hadoop, HDFS, MapReduce.: 5 years (Required)
• Spark, PySpark, and Python.: 5 years (Required)
• NoSQL databases like HBase, Cassandra, and MongoDB.: 5 years (Required)
• working in a CI/CD environment.: 5 years (Required)

Location:

• Bangalore, Karnataka (Required)

Work Location: In person