EY - GDS Consulting - AI And DATA - Databricks Architect - Gig

Overview

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

EY GDS – Data and Analytics - D and A –Gig- Databricks Architect

As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance.

The opportunity

We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.

Education/Qualification: Bachelor’s degree in Computer Science or related field, or equivalent education and experience

Requirements

• 8+ years of proven enterprise Data Architecture experience with expertise in designing and building data platforms and solutions in Azure Databricks and pyspark
• Extensive hands-on experience in Azure Databricks fundamentals/architecture, including setting up and optimizing Azure Databricks clusters and modules (Data Engineering and SQL warehouse).
• Experience building solutions for migrations, batches, and real-time ingestions.
• Strong experience architecting big data solutions using Data Lakes, Data Warehouses, and Data Products.
• Design, develop, and maintain custom connectors or utilize existing frameworks to integrate Databricks with Collibra for metadata ingestion, lineage propagation, and data quality rule mapping.
  
  

• Collaborate with key stakeholders in an Agile environment to understand advanced data requirements and develop technology target states and roadmaps that align with short and long-term business goals.
• Define and implement best practices for data quality, data governance, and data security within Azure Databricks architecture.
• Provide knowledge on advanced concepts such as medallion architecture, DLT, unity catalog within Azure Databricks
• Lead and participate in code reviews, documentation, and knowledge-sharing sessions related to Azure Databricks
• Lead and mentor junior resources
• Support business development efforts (proposals and client presentations)
• Identify opportunities to add value to the client's organization by effective use of information management
• Build relationships with key stakeholders responsible for information and performance management in client's organization
  
  

:

• Databricks
• Pyspark
• Collibra
• Data Modelling
  
  

• Client management skills
  
  

• Minimum 7 years of experience as Architect on Analytics solutions and around 5 years of experience with Azure Databricks / Pyspark and Collibra
• People with technical experience and enthusiasm to learn new things in this fast-moving environment
  
  

At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.

You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:

• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you
  
  

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.