IN-Senior Associate_Data Engineer(PySpark,Python)_Data & Analytics_Advisory_Bangalore

Line of Service
Advisory

Industry/Sector
Not Applicable

Specialism
Data, Analytics & AI

Management Level
Senior Associate

Job Description & Summary
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.

In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage.


*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "


Responsibilities: 

 

• Deliver projects integrating data flows within and across technology systems.  
  

• Lead data modeling sessions with end user groups, project stakeholders, and technology teams to produce logical and physical data models.  
  

• Design end-to-end job flows that span across systems, including quality checks and controls.  
  

• Create technology delivery plans to implement system changes.  
  

• Perform data analysis, data profiling, and data sourcing in relational and Big Data environments.  
  

• Convert functional requirements into logical and physical data models.  
  

• Assist in ETL development, testing, and troubleshooting ETL issues.  
  

• Troubleshoot data issues and work with data providers for resolution; provide L3 support when needed.  
  

• Design and develop ETL workflows using modern coding and testing standards.  
  

• Participate in agile ceremonies and actively drive towards team goals.  
  

• Collaborate with a global team of technologists.  
  

• Lead with ideas and innovation.  
  

• Manage communication and partner with end users to design solutions. 
  
  

• 5 years of project experience in Python/Shell scripting in Data Engineering (experience in building and optimizing data pipelines, architectures, and data sets with large data volumes).  
  

• 3+ years of experience in PySpark scripting, including the architecture framework of Spark.  
  

• 3-5 years of strong experience in database development (Snowflake/ SQL Server/Oracle/Sybase/DB2) in designing schema, complex procedures, complex data scripts, query authoring (SQL), and performance optimization.  
  

• Strong understanding of Unix environment and batch scripting languages (Shell/Python).  
  

• Strong knowledge of Big Data/Hadoop platform.  
  

• Strong engineering skills with the ability to understand existing system designs and enhance or migrate them.  
  

• Strong logical data modeling skills within the Financial Services domain.  
  

• Experience in data integration and data conversions.  
  

• Strong collaboration and communication skills.  
  

• Strong organizational and planning skills.  
  

• Strong analytical, profiling, and troubleshooting skills.  
  
  

• Experience with ETL tools (e.g Informatica, Azure Data Factory) and pipelines across disparate sources is a plus.  
  

• Experience working with Databricks is a plus.  
  

• Familiarity with standard Agile & DevOps methodology & tools (Jenkins, Sonar, Jira).  
  

• Good understanding of developing ETL processes using Informatica or other ETL tools.  
  

• Experience working with Source Code Management solutions (e.g., Git).  
  

• Knowledge of Investment Management Business.  
  

• Experience with job scheduling tools (e.g., Autosys).  
  

• Experience with data visualization software (e.g., Tableau).  
  

• Experience with data modeling tools (e.g., Power Designer).  
  

• Basic familiarity with using metadata stores to maintain a repository of Critical Data Elements. (e.g. Collibra) 
  

• Familiarity with XML or other markup languages. 
  
  

Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of Engineering

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills
ETL Tools

Optional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Communication, Competitive Advantage, Continuous Process Improvement, Creativity, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Embracing Change, Emotional Regulation, Empathy, Inclusion, Industry Trend Analysis {+ 12 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements
Not Specified

Available for Work Visa Sponsorship?
No

Government Clearance Required?
No

Job Posting End Date