Data Engineer

Job Title: Data Engineer

Job Type: Full-Time

Location: On-site Hyderabad, Telangana, India

About us:

Our mission at micro1 is to match the most talented people in the world with their dream jobs. If you are looking to be at the forefront of AI innovation and work with some of the fastest growing companies in Silicon Valley, we invite you to apply for a role. By joining the micro1 community, your resume will become visible to top industry leaders, unlocking access to the best career opportunities on the market.

Job Summary:

We are seeking an accomplished Data Engineer to join our dynamic team in Hyderabad. You will be instrumental in designing, implementing, and optimizing data pipelines that drive our business insights and analytics. If you are passionate about harnessing the power of big data, possess a strong technical skill set, and thrive in a collaborative environment, we would love to hear from you.

Key Responsibilities:

• Develop and maintain scalable data pipelines using Python, PySpark, and SQL.
• Implement robust data warehousing and data lake architectures.
• Leverage the Databricks platform to enhance data processing and analytics capabilities.
• Model, design, and optimize complex database schemas.
• Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
• Lead and mentor junior data engineers and establish best practices.
• Troubleshoot and resolve data processing issues promptly.

Required Skills and Qualifications:

• Strong proficiency in Python and PySpark.
• Extensive experience with the Databricks platform.
• Advanced SQL and data modeling skills.
• Demonstrated experience in data warehousing and data lake architectures.
• Exceptional problem-solving and analytical skills.
• Strong written and verbal communication skills.

Preferred Qualifications:

• Experience with graph databases, particularly MarkLogic.
• Proven track record of leading data engineering teams.
• Understanding of data governance and best practices in data management