Gurugram, Haryana, India
Information Technology
Full-Time
UST
Overview
Role Description
Job Title: Big Data Engineer
Experience Range: 5 to 7 years
Hiring Location: Pune
Notice Period: 0-30 Days
Job Description
We are seeking a Big Data Engineer with 5+ years of experience to play a key role in building, managing, and optimizing our big data pipelines. This role involves working with cutting-edge technologies to enhance product capabilities while collaborating with cross-functional teams.
Key Responsibilities
java,Microservices,Python,Big Data
Job Title: Big Data Engineer
Experience Range: 5 to 7 years
Hiring Location: Pune
Notice Period: 0-30 Days
Job Description
We are seeking a Big Data Engineer with 5+ years of experience to play a key role in building, managing, and optimizing our big data pipelines. This role involves working with cutting-edge technologies to enhance product capabilities while collaborating with cross-functional teams.
Key Responsibilities
- Work closely with Technical Leaders to design and implement robust Big Data solutions.
- Participate in design discussions and brainstorming sessions to evaluate tools and frameworks for Big Data processing.
- Develop and maintain data processing pipelines using distributed frameworks like Apache Spark and Hadoop.
- Implement ETL processes and optimize data workflows using Apache Airflow, dbt, and related tools.
- Ensure data quality, security, and performance in large-scale data processing environments.
- Collaborate with multi-region software and support teams to ensure seamless data integration.
- Stay up to date with the latest advancements in Big Data technologies and contribute to continuous improvements.
- 4+ years of experience in Data Engineering.
- Strong understanding of Big Data ecosystems, including Spark and Hadoop.
- Proficiency in ETL processes and data pipeline orchestration using Apache Airflow, dbt, or similar tools.
- Strong programming skills in Python, Java, or Scala, along with SQL expertise.
- Experience with version control tools (Git) and build tools like Gradle, Maven, or SBT.
- Experience in cloud-based data platforms (AWS, GCP, or Azure).
- Strong understanding of object-oriented programming, data structures, algorithms, and performance optimization.
- Excellent problem-solving, communication, and collaboration skills.
- Experience with data warehouse platforms (Snowflake, Redshift, BigQuery).
- Familiarity with streaming data processing frameworks (Kafka, Flink).
- Knowledge of containerization and orchestration tools (Docker, Kubernetes).
- Exposure to DevOps practices and CI/CD pipelines.
- Bachelor’s/Master’s degree in Computer Science, Information Technology, or a related field.
- 5-7 years of professional experience in Big Data Engineering.
java,Microservices,Python,Big Data
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
1 Day ago
Salesforce commerce cloud consultant
Information Technology
- Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant 5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
1 Day ago
Cloud Infrastructure Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
1 Day ago
Devops Engineer- Intermetiate
Information Technology
- Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
1 Day ago
Sr Data Scientist (London)
Information Technology
- Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
1 Day ago
Software Test Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
1 Day ago
Java Developer - Spring Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in