Free cookie consent management tool by TermsFeed Big Data Engineer - Python/Java/Scala | Antal Tech Jobs
Back to Jobs
1 Day ago

Big Data Engineer - Python/Java/Scala

decor
Hyderabad, Telangana, India
Information Technology
Full-Time
Somani Technologies

Overview

Employment Type : Full-time

Open only for women candidates

About The Role

We are looking for a highly experienced Big Data Engineer with strong hands-on expertise in Python, Java, or Scala, and proven ability to manage and deliver on complex data engineering projects. This is an excellent opportunity for someone passionate about big data technologies and cloud platforms to work on scalable data solutions in a collaborative environment.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines and data lake architectures.
  • Develop robust data engineering solutions using Python, Java, or Scala.
  • Work extensively with Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie.
  • Collaborate with cross-functional teams to ensure high data quality and governance.
  • Leverage cloud platforms like AWS, Azure, or GCP for data processing and infrastructure.
  • Manage and optimize data warehouses, data lakes, and RDBMS such as PostgreSQL or SQL Server.

Required Skills

  • 10+ years of experience in Information Technology, specifically in the Big Data ecosystem.
  • Strong programming skills in Python, Java, or Scala.
  • Deep knowledge and hands-on experience with Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie.
  • Experience with cloud environments (AWS, Azure, or GCP).
  • Good understanding of data modeling, data architecture, and data governance principles.
  • Familiarity with version control (Git), Docker, and orchestration tools like Kubernetes is a plus.

Preferred Qualifications

  • Experience in real-time data processing using Kafka or Spark Streaming.
  • Exposure to NoSQL databases such as MongoDB or Cassandra.
  • Certification in AWS Big Data or equivalent is a strong advantage.

(ref:hirist.tech)
Share job
Similar Jobs
View All
5 Hours ago
Lead Python Developer
Information Technology
  • 8 - 12 Yrs
  • Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
decor
23 Hours ago
US Voice Process (Banking Domain)
Telecommunications
  • 40000 - 45000 INR - Monthly
  • 1 - 1 Yrs
  • Greater Noida
Process: US Voice – Banking (International) Eligibility: Graduate / Undergraduate with 6 months international voice process experience Experience: 6 months – 2+ years (in International BPO – Voice) Salary: ₹40,000 CTC (6 months+ experienc...
decor
1 Day ago
Software/Web Developer - AngularJS/Javascript
Information Technology
  • Hyderabad, Telangana, India
We are hiring for women who are on career break in Hyderabad.Company : MicronRole : Software Developer - Application Development and SupportSkills : Web Development, JavaScript & Angular, C# & SQL, Agile methodologies, API, Cloud experience Azure, A...
decor
1 Day ago
OculusIT - Network Administrator
Information Technology
  • Hyderabad, Telangana, India
Company DescriptionOculusIT is higher education's high-touch, customer-centric IT services partner of choice.They specialize in cost-effective, responsive, and flexible IT Leadership; Managed ERP, Security, and Infrastructure Services; and 24x7 Oper...
decor
1 Day ago
Software Engineer - Backend Technologies
Information Technology
  • Pune, Maharashtra, India
Job DescriptionOur engineering team is hiring a backend software engineer to contribute to the development of our Warehouse Management System (WMS) and its companion Handy Terminal device, both of which are integral to our logistics product suite.Th...
decor
1 Day ago
DevOps Engineer - Cloud Infrastructure
Information Technology
  • Hyderabad, Telangana, India
Key Responsibility Areas (KRAs) CI/CD Pipeline Management : Design, build, and maintain robust, automated CI/CD pipelines for various applications, ensuring seamless integration, testing, and deployment processes. Infrastructure as Code (IaC) : De...
decor
1 Day ago
Software Engineer - Frontend Internship in Noida, Gurgaon
Information Technology
  • Pune, Maharashtra, India
Selected Intern's Day-to-day Responsibilities Include Develop web apps and landing pages as provided by the designer Work on challenging projects involving heavy rendering Demonstrate team spirit and collaborate with peers About Company: Nicola ...
decor
1 Day ago
Snowflake Data Engineer - SQL
Information Technology
  • Pune, Maharashtra, India
About The JobExp : 8 - 14 YrsWork Mode : HybridLocation : Bangalore, Chennai, Kolkata, Pune and GurgaonPrimary Skills : Architect, Snowflake, SQL, DWH, Power BI, ETL and Informatica.We are seeking a skilled Snowflake Developer with a strong backgrou...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media