Principal Data Engineer

Job Title:

Principal Data Engineer

About Skyhigh Security:

Skyhigh Security is a dynamic, fast-paced, cloud company that is a leader in the security industry. Our mission is to protect the world’s data, and because of this, we live and breathe security. We value learning at our core, underpinned by openness and transparency.

Since 2011, organizations have trusted us to provide them with a complete, market-leading security platform built on a modern cloud stack. Our industry-leading suite of products radically simplifies data security through easy-to-use, cloud-based, Zero Trust solutions that are managed in a single dashboard, powered by hundreds of employees across the world. With offices in Santa Clara, Aylesbury, Paderborn, Bengaluru, Sydney, Tokyo and more, our employees are the heart and soul of our company.

Skyhigh Security Is more than a company; here, when you invest your career with us, we commit to investing in you. We embrace a hybrid work model, creating the flexibility and freedom you need from your work environment to reach your potential. From our employee recognition program, to our ‘Blast Talks' learning series, and team celebrations (we love to have fun!), we strive to be an interactive and engaging place where you can be your authentic self.

We are on these too! Follow us on LinkedIn and Twitter@SkyhighSecurity.

Role Overview:

Principal Data Engineer, you will be responsible for:

Leading the design and implementation of high-scale, cloud-native data pipelines for real-time and batch workloads.

Collaborating with product managers, architects, and backend teams to translate business needs into secure and scalable data solutions.

Integrating big data frameworks (like Spark, Kafka, Flink) with cloud-native services (AWS/GCP/Azure) to support security analytics use cases.

Driving CI/CD best practices, infrastructure automation, and performance tuning across distributed environments.

Evaluating and piloting the use of AI/LLM technologies in data pipelines (e.g., anomaly detection, metadata enrichment, automation).

Our Engineering team is driving the future of cloud security—developing one of the world’s largest, most resilient cloud-native data platforms. At Skyhigh Security, we’re enabling enterprises to protect their data with deep intelligence and dynamic enforcement across hybrid and multi-cloud environments. As we continue to grow, we’re looking for a Principal Data Engineer to help us scale our platform, integrate advanced AI/ML workflows, and lead the evolution of our secure data infrastructure.

Responsibilities:

• As a Principal Data Engineer, you will be responsible for:
• Leading the design and implementation of high-scale, cloud-native data pipelines for real-time and batch workloads.
• Collaborating with product managers, architects, and backend teams to translate business needs into secure and scalable data solutions.
• Integrating big data frameworks (like Spark, Kafka, Flink) with cloud-native services (AWS/GCP/Azure) to support security analytics use cases.
• Driving CI/CD best practices, infrastructure automation, and performance tuning across distributed environments.
• Evaluating and piloting the use of AI/LLM technologies in data pipelines (e.g., anomaly detection, metadata enrichment, automation).
• Evaluate and integrate LLM-based automation and AI-enhanced observability into engineering workflows.
• Ensure data security and privacy compliance.
• Mentoring engineers, ensuring high engineering standards, and promoting technical excellence across teams.
  
  

What We’re Looking For (Minimum Qualifications)

• 10+ years of experience in big data architecture and engineering, including deep proficiency with the AWS cloud platform.
• Expertise in distributed systems and frameworks such as Apache Spark, Scala, Kafka, Flink, and Elasticsearch, with experience building production-grade data pipelines.
• Strong programming skills in Java for building scalable data applications.
• Hands-on experience with ETL tools and orchestration systems.
• Solid understanding of data modeling across both relational (PostgreSQL, MySQL) and NoSQL (HBase) databases and performance tuning.
  
  

What Will Make You Stand Out (Preferred Qualifications)

• Experience integrating AI/ML or LLM frameworks (e.g., LangChain, LlamaIndex) into data workflows.
• Experience implementing CI/CD pipelines with Kubernetes, Docker, and Terraform.
• Knowledge of modern data warehousing (e.g., BigQuery, Snowflake) and data governance principles (GDPR, HIPAA).
• Strong ability to translate business goals into technical architecture and mentor teams through delivery.
• Familiarity with visualization tools (Tableau, Power BI) to communicate data insights, even if not a primary responsibility.
  
  

Company Benefits and Perks:

We believe that the best solutions are developed by teams who embrace each other's unique experiences, skills, and abilities. We work hard to create a dynamic workforce where we encourage everyone to bring their authentic selves to work every day. We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.

• Retirement Plans
• Medical, Dental and Vision Coverage
• Paid Time Off
• Paid Parental Leave
• Support for Community Involvement
  
  

We're serious about our commitment to a workplace where everyone can thrive and contribute to our industry-leading products and customer support, which is why we prohibit discrimination and harassment based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.