Big Data Engineer

Overview

Job Title: Big Data Engineer
Location: Chennai, Bangalore, Pune
Job Type: Full-time

Job Summary:
We are seeking a Big Data Engineer to design, develop, and optimize large-scale data processing systems. The ideal candidate has expertise in big data frameworks, distributed computing, and cloud-based data solutions.

Key Responsibilities:

• Design and implement scalable big data architectures.
• Develop and maintain ETL pipelines for data ingestion, transformation, and storage.
• Work with Hadoop, Spark, Kafka, and other distributed data processing frameworks.
• Optimize query performance and data workflows for large datasets.
• Implement real-time data streaming and processing solutions.
• Ensure data security, integrity, and compliance with industry standards.
• Collaborate with data scientists, analysts, and business teams to deliver insights.

Qualifications:

• Bachelor’s/Master’s degree in Computer Science, Data Engineering, or related field.
• 3+ years of experience in big data engineering and distributed computing.
• Strong proficiency in SQL, Python, Scala, or Java.
• Hands-on experience with Hadoop, Spark, Hive, Kafka, and cloud-based data platforms (AWS, Azure, GCP).
• Knowledge of data warehousing, NoSQL databases, and columnar storage.
• Experience with containerization (Docker, Kubernetes) and CI/CD for data pipelines.

Job Type: Full-time

Work Location: In person