Staff Software Engineer

Overview

Engineering

Seniority Level:

Mid-Senior level

Job Description:

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance.

We are seeking an experienced Staff Software Engineer to join our Replication Manager team at Cloudera. In this role, you will be responsible for designing, developing, and maintaining enterprise-grade data replication solutions that enable seamless data movement across hybrid and multi-cloud environments. You'll work on critical infrastructure that helps Fortune 500 companies manage their data lifecycle and migration strategies.

As a Staff Software Engineer you will:

• Design and implement scalable data replication services for HDFS, Hive, HBase, Apache Iceberg, and other big data technologies.
• Develop robust APIs and microservices for the Replication Manager platform.
• Lead complex technical initiatives involving data migration between on-premises clusters and cloud environments (AWS S3, Azure ADLS Gen2).
• Architect fault-tolerant, distributed systems for high-volume, petabyte-scale data operations with minimal downtime and data consistency guarantees.
• Optimize replication performance and implement advanced features like bandwidth throttling, scheduling, and policy management.
• Mentor junior engineers and provide technical guidance on best practices.
• Implement monitoring, alerting, and observability features for replication jobs.
• Ensure security and governance policies are maintained using tools like Apache Atlas.
• Partner with Cloudera Data Platform (CDP) teams and collaborate with field engineering to address customer requirements and escalations.
• Participate in code reviews and contribute to technical documentation.
  
  
  

We’re excited about you if you have:

• 8+ years of software engineering experience with distributed systems.
• Strong proficiency in Java, Scala, or Python for backend development.
• Deep understanding of Apache Hadoop ecosystem (HDFS, Hive, HBase, YARN).
• Experience with modern data formats including Apache Iceberg, Delta Lake, and Hive ACID tables.
• Experience with cloud platforms (AWS, Azure, GCP) and their storage services.
• Proven experience designing and implementing large-scale distributed systems, understanding CAP theorem and data consistency models.
• Knowledge of API design, microservices architecture, security protocols, and data governance frameworks.
• Strong background in SDLC, agile methodologies, CI/CD pipelines, and automated testing frameworks.
  
  
  

You may also have:

• Experience with Apache Ranger/Atlas or Apache Iceberg replication specifics.
• Knowledge of enterprise backup/DR or history in data migration/ETL.
• Open-source contributions or experience in customer-facing support roles.
  
  
  

You will tackle complex distributed systems challenges, crafting the foundational software for the control and data planes that powers CDP and keeps it running at massive scale. Working at the forefront of hybrid and multi-cloud technology, you will empower data scientists, engineers, and analysts with the tools and infrastructure they need for advanced analytics and modeling.

Collaboration is key, you will work alongside brilliant minds across product, data science, and engineering to drive innovation, standardize best practices, and shape the future of enterprise AI and data platforms. This is your chance to build the future of data and see your work make a global impact.

What you can expect from us:

• Generous PTO Policy
• Support work life balance with Unplugged Days
• Flexible WFH Policy
• Mental & Physical Wellness programs
• Phone and Internet Reimbursement program
• Access to Continued Career Development
• Comprehensive Benefits and Competitive Packages
• Paid Volunteer Time
• Employee Resource Groups
  
  
  

EEO/VEVRAA