Free cookie consent management tool by TermsFeed Data Engineer - Hadoop/Hive/Scala | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer - Hadoop/Hive/Scala

decor
Gurugram, Haryana, India
Information Technology
Full-Time
consultant

Overview

Key Responsibilities

  • Design, develop, and maintain large-scale, high-performance big data applications.
  • Work with Hadoop, Hive, and Spark (Scala) to process and analyze large datasets.
  • Build efficient, reusable, and reliable data solutions to support business needs.
  • Collaborate with cross-functional teams (data scientists, analysts, product teams) to define data requirements.
  • Develop and optimize SQL queries (preferably PostgreSQL) for data analysis and reporting.
  • Write unit and integration tests using Scalatest to ensure code quality and reliability.
  • Manage code versioning and collaboration using Git.
  • Contribute to CI/CD pipelines (experience with Jenkins is a plus).
  • Ensure data security, compliance, and governance standards are met.

Required Skills & Qualifications

  • 511 years of hands-on experience in big data engineering.
  • Strong expertise in Hadoop, Hive, and Spark (Scala).
  • Solid experience in RDBMS and at least one SQL database (PostgreSQL preferred).
  • Experience in writing unit and integration tests using Scalatest.
  • Proficiency in using Git for version control.
  • Experience with CI/CD pipelines; Jenkins knowledge is an added advantage.
  • Strong problem-solving and analytical skills with the ability to handle complex data challenges.
  • Excellent communication and collaboration skills.

(ref:hirist.tech)
Share job
Similar Jobs
View All
16 Hours ago
Principal Engineer - UI/UX
Information Technology
  • 6 - 11 Yrs
  • Mumbai (All Areas)
looking for a technically savvy and experienced Principal Engineer to take up front-end development efforts. You will design and develop elegant interfaces that exceed client expectations in terms of value and benefit. You will collaborate on scalabi...
decor
16 Hours ago
Principal Engineer - Beckend
Information Technology
  • 7 - 11 Yrs
  • Mumbai (All Areas)
Principal Engineer - Backend Mumbai, Maharashtra, India | Product Engineering | Full-time We are looking for a technically savvy and experienced senior developer to lead development efforts. You will help the team grow in size and skills, optim...
decor
16 Hours ago
Principal Engineer - DevOps/DBA
Information Technology
  • 7 - 11 Yrs
  • Mumbai (All Areas)
we are looking for a technically savvy and passionate Principal DevOps Engineer or Senior Database Administrator to cater to the development and operations efforts in product. You will choose and deploy tools and technologies to build and support a r...
decor
18 Hours ago
C++ Developer | 5 - 8 Years
Information Technology
  • 30 - 45 INR - Yearly
  • 5 - 12 Yrs
  • Pune
About the Client: The company has been a global leader in delivering cutting-edge in-flight entertainment and connectivity (IFEC) solutions for over 40 years. About the Role: Title: SDE 3 C++ - 5 to 8 Years SDE 4 C++ - 8 to 13 Years ...
decor
2 Days ago
Business Analyst(GRC Domain) Internship in Hyderabad
Information Technology
  • Gurugram, Haryana, India
Selected Intern's Day-to-day Responsibilities Include Gather, analyze, and document business requirements. Translate business needs into functional specifications and user stories. Support in preparing business requirement documents (BRD), functi...
decor
2 Days ago
Creditsafe - Data Test Engineer
Information Technology
  • Gurugram, Haryana, India
We are looking for a Test Engineer who will become part of our team building and testing the Creditsafe data.You will be working closely with the database teams and data engineering to build specific systems facilitating the extraction and transform...
decor
2 Days ago
Business Advisory Analyst
Information Technology
  • Gurugram, Haryana, India
Skill required: Finance & Accounting - Budgeting and ForecastingDesignation: Business Advisory AnalystQualifications:Any GraduationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with leading capabi...
decor
2 Days ago
IN_Senior Associate_.Net Developer_Emerging Businesses_Advisory_Gurugram
Information Technology
  • Gurugram, Haryana, India
Line of ServiceAdvisory Industry/SectorNot Applicable SpecialismEmerging Technologies Management LevelSenior Associate Job Description & SummaryAt PwC, our people in software and product innovation focus on developing cutting-edge software solutions...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media