Data Engineer 2

As a Data Engineer 2, you will act as a key member of the Data consulting team, working directly with the partners and senior  stakeholders of the clients designing and implementing big data and analytics solutions. Communication  and organisation skills are keys for this position, along with a problem-solution attitude. 

What is in it for you: 

• Opportunity to work with a world class team of business consultants and engineers solving some of  the most complex business problems by applying data and analytics techniques 

• Fast track career growth in a highly entrepreneurial work environment 

• Best-in-industry renumeration package 

Essential Technical Skills: 

• Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure,  Git, SQL and Databricks; and visualization tools: Tableau and PowerBI 

• Experience with cloud, container and micro service infrastructures 

• Experience working with divergent data sets that meet the requirements of the Data Science and  Data Analytics teams 

• Hands-on experience with data modelling, query techniques and complexity analysis 

Desirable Skills: 

• Experience/Knowledge of working in an agile environment and experience with agile  methodologies such as Scrum 

• Experience of working with development teams and product owners to understand their  requirement 

• Certifications on any of the above areas will be preferred. 

Responsibilities: 

• Develop data solutions within a Big Data Azure and/or other cloud environments • Working with divergent data sets that meet the requirements of the Data Science and Data Analytics  teams 

• Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse • Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps  showing key items such as upgrades, technical refreshes and new versions 

• Perform data mapping activities to describe source data, target data and the high-level or  detailed transformations that need to occur; 

• Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau • Data Integration, Transformation, Modelling 

• Maintaining all relevant documentation and knowledge bases 

• Research and suggest new database products, services and protocols