Sr. Data Engineer

Eightfold was founded with a vision to solve for employment in our society. For decades, the connection between individuals and opportunities has been based on who they are and their network's strength vs. their potential. Eightfold leverages artificial intelligence to transform how to think about skills and capabilities for individuals and how jobs and career decisions are made. Eightfold offers the industry’s first AI-powered Talent Intelligence Platform to transform how organizations plan, hire, develop and retain a diverse workforce, enabling individuals to transform their careers.

To date, Eightfold AI has received more than $410 million in funding and a valuation of over $2B from leading investors to further our mission of finding the right career for everyone in the world. If you are passionate about solving one of the most fundamental challenges of our society - employment, working on hard business problems, and being part of an amazing growth story - Eightfold is the place to be!

Our customer stories- https://eightfold.ai/customers/customer-stories/

Press- https://eightfold.ai/about/press

About The Role

We are looking for a Data Engineer II, Analytics to join our growing team and help build scalable, high-performance data pipelines that enable meaningful business insights. You’ll work with modern data tools, collaborate with cross-functional teams, and contribute to building a robust data foundation that supports Eightfold’s AI-driven analytics and reporting needs.

What You Will Learn To Do

Design & Develop Pipelines: Build, maintain, and optimize reliable ETL/ELT pipelines to ingest, process, and transform large datasets from diverse sources using Databricks and Amazon Redshift.

Data Modeling & Architecture: Support the design and implementation of scalable data models and architectures to meet evolving analytics and business intelligence needs.

Data Quality & Integration: Ensure accuracy, consistency, and quality of integrated data from structured and unstructured sources across systems.

Performance Tuning: Optimize the performance of queries, pipelines, and databases to ensure high efficiency and reliability for analytics workloads.

Collaboration & Delivery: Partner with analytics engineers, data scientists, product managers, and business stakeholders to deliver high-quality data solutions that enable business insights and product innovations.

Documentation & Best Practices: Contribute to documentation, promote data engineering best practices, and ensure data governance, security, and compliance standards are upheld.

What We Need

Experience: 3–6 years of hands-on experience as a Data Engineer or in a similar data engineering role, ideally in analytics-focused environments.

Databricks: Practical experience building and managing pipelines and workflows using Databricks.

Amazon Redshift: Strong understanding of Amazon Redshift, including data modeling and query optimization.

Programming: Proficiency in SQL and working knowledge of Python or Scala for data processing tasks.

ETL/ELT Tools: Hands-on experience developing and maintaining ETL/ELT processes.

Big Data Tools (Good to Have): Familiarity with Apache Spark, Hadoop, Kafka, or other big data technologies is a plus.

Analytical & Problem-Solving Skills: Ability to troubleshoot data issues and optimize performance effectively.

Communication & Collaboration: Strong communication skills with a collaborative mindset in fast-paced environments.

Hybrid Work @ Eightfold: We embrace a hybrid work model that aims to boost collaboration, enhance our culture, and drive innovation through a blend of remote and in-person work. We are committed to creating a dynamic and flexible work environment that nurtures the collaborative spirit of our team. Starting February 1, 2024, our employees will return to the office twice a week. We have offices in Bangalore and Noida in India.

Eightfold.ai provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, or disability.

Experience our comprehensive benefits with family medical, vision and dental coverage, a competitive base salary, and eligibility for equity awards and discretionary bonuses or commissions.