Senior Data Engineer - Azure

Job Description:

MUST have skills

• Microsoft Azure BI Stack (ADF, Azure Databricks, PySpark, ADLS)
• SQL
• Python
• Understanding of Big Data, ETL concepts
• Experience in Azure Analytics and DevOps
• Experience in building data pipelines using Python, PySpark & Spark SQL

Responsibilities

• Play the role of senior developer for the assigned projects
• Provide technology consulting to customers and internal project teams
• Responsible for create/maintain scalable ETL pipeline with Azure data factory
• Responsible to ingest data from various sources.
• Create complex ETL work flows using ADF, ADB, ADL and Datawarehouse
• Responsible for creating Databricks notebooks using PySpark for performing data cleansing, transformation and processing
• Deployment of code using CI/CD pipelines

General Skills

• At least 3-5 years’ relevant experience as Data Engineer in Azure Stack
• Strong communication skills, ability to work directly with client and to lead junior team members
• Problem solving and analytical skills
• Ability to explore emerging technologies
• Eagerness to learn and ability to adapt to changes
• Experience with Azure ARM templates, PowerShell and CI/CD using Azure DevOps

Nice to have skills

• Azure DP 203 Certified
• PowerBI
• Apache Airflow
• Automation scripts
• Log Analytics, KQL
• Understanding of DWH concepts
• Good Knowledge of database modelling and database performance tuning.

Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here.