Data Engineer

About us:

Our mission at micro1 is to match the most talented people in the world with their dream jobs. If you are looking to be at the forefront of AI innovation and work with some of the fastest growing companies in Silicon Valley, we invite you to apply for a role. By joining the micro1 community, your resume will become visible to top industry leaders, unlocking access to the best career opportunities on the market.

Job Summary:

Join our innovative customer's team as a Data Engineer and drive the development and optimization of advanced, data-driven solutions. This is an exciting opportunity to shape robust data architectures and empower high-impact analytics within a collaborative environment dedicated to excellence in data engineering.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
• Architect and manage data warehouses and data lakes to support a wide range of analytics and business intelligence needs.
• Utilize Databricks to enhance data processing performance and enable sophisticated analytics solutions.
• Model, design, and optimize complex relational database schemas for scalability and reliability.
• Collaborate closely with cross-functional teams to gather requirements and deliver effective, high-quality data solutions.
• Mentor junior engineers, promoting best practices and fostering technical growth across the team.
• Troubleshoot, diagnose, and resolve issues within data workflows to ensure seamless operation and data quality.

Required Skills and Qualifications:

• Advanced proficiency in Python and PySpark, with hands-on experience in building data engineering solutions.
• Deep expertise with Databricks, especially in large-scale data processing and analytics.
• Expert-level skills in MySQL, advanced SQL, and data modeling methodologies.
• Strong experience architecting and implementing data warehousing and data lake solutions.
• Exceptional analytical and problem-solving abilities with meticulous attention to detail.
• Excellent written and verbal communication skills, capable of clearly articulating complex data concepts.

Preferred Qualifications:

• Experience with graph databases, particularly MarkLogic.
• Demonstrated leadership in mentoring and guiding data engineering teams.
• Understanding of data governance principles and best practices in data management.