Data Engineer -Analytics aaS Associate - Operate.

At PwC, our people in managed services focus on a variety of outsourced solutions and support clients across numerous functions. These individuals help organisations streamline their operations, reduce costs, and improve efficiency by managing key processes and functions on their behalf. They are skilled in project management, technology, and process optimization to deliver high-quality services to clients. Those in managed service management and strategy at PwC will focus on transitioning and running services, along with managing delivery teams, programmes, commercials, performance and delivery risk. Your work will involve the process of continuous improvement and optimising of the managed services process, tools and services.

Job Title: Data Engineer – Offshore,

KEY SKILLS - Tera Data, data stage, AWS, Data Bricks, SQL, Delta Live tables, Delta tables, Spark - Kafka, Spark Streaming, MQ, ETL

Summary: We are seeking an experienced Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in a variety of data technologies, including Teradata, DataStage, AWS, Databricks, SQL, and more. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and systems that support our data-driven initiatives.

Minimum Degree Required: Bachelor's degree in computer science/IT or relevant field

Degree Preferred: Master’s degree in computer science/IT or relevant field

Minimum Years of Experience: 2 - 5 year(s)

Certifications Required: NA

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines using DataStage and other ETL tools.
• Leverage AWS cloud services for data storage, processing, and analytics.
• Utilize Databricks to analyze, process, and transform data, ensuring high performance and reliability.
• Implement and optimize Delta Live Tables and Delta Tables for efficient data storage and querying.
• Work with Apache Spark to process large datasets, ensuring optimal performance and scalability.
• Integrate Kafka and Spark Streaming to build real-time data processing applications.
• Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
• Ensure data quality, integrity, and security across all data systems and pipelines.
• Monitor and troubleshoot data workflows to ensure smooth operations.
• Document data processes, architecture designs, and technical specifications.
  
  

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with relational databases such as Teradata.
• Hands-on experience with AWS services such as S3, EMR, Redshift, and Lambda.
• Proficiency in using Databricks for data engineering tasks.
• Experience with Delta Live Tables and Delta Tables in a data engineering context.
• Solid understanding of Apache Spark, Kafka, and Spark Streaming.
• Experience with messaging systems like MQ is a plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
  
  

Preferred Skills

• Experience with data warehousing and big data technologies.
• Familiarity with data governance and data security best practices.
• Certification in AWS or Databricks is a plus.
  
  

Job Summary -

A career in our Managed Services team will provide you with an opportunity to collaborate with a wide array of teams to help our clients implement and operate new capabilities, achieve operational efficiencies, and harness the power of technology. Our Data, Testing & Analytics as a Service team brings a unique combination of industry expertise, technology, data management and managed services experience to create sustained outcomes for our clients and improve business performance. We empower companies to transform their approach to analytics and insights while building your skills in exciting new directions. Have a voice at our table to help design, build and operate the next generation of software and services that manage interactions across all aspects of the value chain.

Minimum Degree Required (BQ) *:

Bachelor's degree

Degree Preferred

Required Field(s) of Study (BQ):

Preferred Field(s) Of Study

Computer and Information Science, Management Information Systems

Minimum Year(s) of Experience (BQ) *: US

Certification(s) Preferred

Minimum of 1 year of experience

Preferred Skills (PQs)

Position Requirements:

Datasphere

Required Skills:

• More than 2 years of hands-on experience in SAP Datasphere / DWC at least 1 full life cycle project implementation.
• Work on development/maintenance of DWC Models, CDS Views, SQL Scripts SAC Stories
• Should have experience in building complex models in SAP Datasphere/ DWC
• Developing SAP Datasphere end-to-end Dataflows Design, build data flows, and develop chains to load and monitor Data Loading.
• Knowledge in setting up the connections to Datasphere and from Datasphere.
• Knowledge in handling the delta in Datasphere.
• Unit testing the dataflows and reconciling the data to Source Systems.
• Good exposure in troubleshooting data issues and provide workarounds in cases where there are product limitations.
• Good exposure with Datasphere security setup, currency conversion.
• Good knowledge in writing CDS Analytical Queries and S4HANA Embedded Analytics.
• Good exposure in performance tuning of the models in the datasphere.
• Good knowledge on Datasphere and Data Lake integration.
• Good Knowledge on using the Database explorer and SAP Hana Cockpit through Datasphere.
  
  

Nice To Have

• Good knowledge in either BW Modeling or HANA Modeling.
• BW/4HANA And/or Native HANA (or HANA Cloud) modeling, including SQL Scripting, Graphical View-Modelling, SDA extraction.