Free cookie consent management tool by TermsFeed Big Data Engineer - Spark/Scala | Antal Tech Jobs
Back to Jobs
1 Day ago

Big Data Engineer - Spark/Scala

decor
Hyderabad, Telangana, India
Information Technology
Full-Time
Strategic HR Solutions

Overview

Spark Scala Developer

Location : Bengaluru, Mumbai

Employment Type : Full-time

What Were Looking For

Were hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scalas functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus.

Your Responsibilities

  • Design and develop scalable data pipelines using Apache Spark and Scala
  • Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)
  • Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/Azure
  • Write clean, modular Scala code using functional programming principles
  • Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes
  • Ensure code quality, documentation, and CI/CD practices are followed

Must-Have Skills

  • 3+ years of experience with Apache Spark in Scala
  • Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning
  • Hands-on experience with performance tuning in production Spark jobs
  • Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either)
  • Proficiency in SQL
  • Experience with any major cloud platform: AWS, Azure, or GCP

Nice-to-Have

  • Worked with Databricks, Snowflake, or Delta Lake
  • Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery
  • Familiarity with CI/CD pipelines and Git-based workflows
  • Comfortable with SQL optimization and schema design in distributed environments

(ref:hirist.tech)
Share job
Similar Jobs
View All
1 Day ago
Software Engineer
Information Technology
  • 900000 - 900000 INR - Yearly
  • Noida, Uttar Pradesh, India
Job Title: MERN Stack Developer Location: Noida (On-site) Experience: 2 – 3 Years Working Days: 6 Days a Week Budget: Up to ₹9 LPA About GoodSpace GoodSpace is an AI-powered HR Tech platform revolutionizing how companies discover, evaluate, and hire...
decor
1 Day ago
Associate Software Developer in Gautam Buddha Nagar, Noida
Information Technology
  • Noida, Uttar Pradesh, India
Are you a talented and ambitious Java Developer looking to take your career to the next level? Namekart is seeking a dynamic Associate Software Developer to join our innovative team in the NOIDA office.As an integral member of our software developme...
decor
1 Day ago
DevOps Engineer
Information Technology
  • Noida, Uttar Pradesh, India
Job Title: Dev Ops EngineerStreamGradeReporting ToLocationSoftware Development ManagerBangalorePurposeThe DevOps Engineer will be responsible for designing and maintaining robust automated build systems, managing source control repositories, and int...
decor
1 Day ago
Software Developer
Information Technology
  • Noida, Uttar Pradesh, India
Role Description This is a full-time remote role for a Software Developer at Employer Connect. The Software Developer will be responsible for designing, developing, and maintaining software applications. Day-to-day tasks include writing clean, scala...
decor
1 Day ago
Java Developer
Information Technology
  • Noida, Uttar Pradesh, India
Responsibilities Design, develop, and maintain high-quality Java-based microservices using frameworks like Spring Boot. Implement and manage Apache Kafka for messaging, event streaming, and real-time data processing. Collaborate with cross-functiona...
decor
1 Day ago
Technical Lead
Information Technology
  • Noida, Uttar Pradesh, India
Job DescriptionNokia’s Network Services Platform (NSP) is the network automation platform of choice for the world’s most advanced communications service providers, and as a Senior Software Engineer on the Network Automation team, you'll leverage you...
decor
1 Day ago
Expert DevOps Engineer
Information Technology
  • Noida, Uttar Pradesh, India
This job is with Finastra, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who are we?At Finastra, we are a dynamic global provider of open...
decor
1 Day ago
WordPress + PHP Developer
Information Technology
  • 180000 - 180000 INR - Yearly
  • Noida, Uttar Pradesh, India
Experience: 1-2 Years in PHP WordPress Budget : INR 1.8LPA - 3LPA Develop and maintain WordPress-based websites and custom themes/plugi ns.Work with PHP, MySQL, HTML5, CSS3, JavaScript, and jQue ry.Integrate third-party APIs and troubleshoot is...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media