Senior Data Engineer (Azure)

Company Name - Aays Analytics

Job Summary -

You will act as a key member of the Data consulting team, working directly with partners and senior stakeholders. You will design and implement big data and analytics solutions. Communication and organisational skills are key for this position.

Key Responsibilities

• Develop data solutions within a Big Data Azure and/or other cloud environments
• Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams
• Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse
• Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps
• Perform data mapping activities to describe source data, target data and the high-level or detailed transformations
• Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau
• Data Integration, Transformation, Modelling
• Maintaining all relevant documentation and knowledge bases
• Research and suggest new database products, services and protocols

Must Have Skills

• Technical expertise with emerging Big Data technologies, such as: Python, Spark, Git, SQL
• Experience with cloud, container and micro service infrastructures
• Experience working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams
• Hands-on experience with data modelling, query techniques and complexity analysis
• Hands-on experience with Azure and Databricks
• Experience with CI/CD and DevOps