Bangalore, Karnataka, India
Information Technology
Full-Time
AppSierra
Overview
Responsibilities
- Design, build, and maintain efficient and reliable data pipelines using Scala, Databricks, and Kafka.
- Collaborate with data scientists and analysts to understand data requirements and provide solutions that meet their needs.
- Optimize ETL processes for performance and scalability, ensuring high data quality and integrity.
- Implement data streaming solutions to facilitate real-time data processing and analytics initiatives.
- Monitor and troubleshoot data pipelines, addressing performance issues and minimizing downtime.
- Participate in code reviews and ensure adherence to best practices in data engineering and software development.
- Stay up-to-date with emerging technologies and industry trends to continuously improve data engineering practices.
- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
- 5-8 years of experience in data engineering or a related field with a focus on big data technologies.
- Strong proficiency in Scala and experience with functional programming paradigms.
- Hands-on experience with Databricks and Spark for data processing and analytics.
- Proficient in Kafka for building real-time data streaming applications.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Experience with cloud-based data platforms, preferably AWS, Azure, or Google Cloud.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in