Pune, Maharashtra, India
Information Technology
Full-Time
True Talents
Overview
Job Title : Big Data Engineer
Location : Bangalore / Pune
Employment Type : Full Time
Experience : 4 to 8 years
Notice Period : 15 days
About The Role
We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems. The ideal candidate will have hands-on experience with big data technologies and a strong ability to build scalable and high-performance data pipelines.
Key Responsibilities
Location : Bangalore / Pune
Employment Type : Full Time
Experience : 4 to 8 years
Notice Period : 15 days
About The Role
We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems. The ideal candidate will have hands-on experience with big data technologies and a strong ability to build scalable and high-performance data pipelines.
Key Responsibilities
- Design and implement big data pipelines and ETL processes using Hadoop, Spark, Hive, and Kafka.
- Develop and maintain data ingestion, processing, and storage frameworks for high-volume datasets.
- Optimize and tune big data applications for performance and scalability.
- Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
- Ensure data quality, security, and compliance with industry best practices.
- Monitor, troubleshoot, and resolve issues in production big data environments.
- 4 to 8 years of experience in big data engineering or related roles.
- Strong expertise in Hadoop ecosystem : HDFS, YARN, MapReduce.
- Hands-on experience with Apache Spark, Hive, and Kafka.
- Proficiency in SQL and at least one programming language (Java/Scala/Python).
- Good understanding of data modeling, distributed computing, and performance tuning.
- Experience with real-time data streaming and batch processing.
- Strong problem-solving skills and ability to work in a fast-paced environment.
- Experience with cloud platforms (AWS, Azure, or GCP) and big data services.
- Knowledge of data lake architectures, NoSQL databases (HBase, Cassandra, etc.).
- Familiarity with containerization (Docker, Kubernetes).
- Opportunity to work on cutting-edge big data technologies and large-scale projects.
- Collaborative work culture and exposure to challenging data engineering problems.
- Competitive salary and growth opportunities in a rapidly evolving data-driven industry.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in