Data Engineer

Location: Remote

Experience: 5+ years

Company Description: CrossAsyst redefines the way companies experience and benefit from technology. Our delivery model is infused with a distinct culture of high customer satisfaction. We deliver trusted partnership, cost reductions and business results by driving technology innovation for better and faster outcomes.

Job Description:

• Maintain & develop data platforms based on Microsoft Fabric for Business Intelligence & Databricks for real-time data analytics
• Design, implement and maintain standardized production-grade data pipelines using modern data transformation processes and workflows for SAP, MS Dynamics, on-premises or cloud.
• Develop an enterprise-scale cloud-based Data Lake for business intelligence solutions.
• Translate business and customer needs into data collection, preparation and processing requirements.
• Optimize the performance of algorithms developed by Data Scientists
• General administration and monitoring of the data platforms

Competencies:

• working with structured & unstructured data
• experienced in various database technologies (RDBMS, OLAP, Timeseries, etc.)
• solid programming skills (Python, SQL, Scala is a plus)
• experience in Microsoft Fabric (incl. Warehouse, Lakehouse, Data Factory, DataFlow Gen2, Semantic Model) and/or Databricks (Spark)
• proficient in PowerBI
• experienced working with APIs
• proficient in security best practices
• data centered Azure know-how is a plus (Storage, Networking, Security, Billing)
  

Education / experience / language:

• Bachelor's or master's degree in business informatics, computer science, or equal
• A background in software engineering (e.g., agile programming, project organization) and experience with human centered design would be desirable
• Extensive experience in handling large data sets
• Experience working at least 5 years as a data engineer, preferably in an industrial company
• Analytical problem-solving skills and the ability to assimilate complex information
• Programming experience in modern data-oriented languages (SQL, Python)
• Experience with Apache Spark and DevOps Rev. Dat. Sig. Ersatz für Seite 2 von 2 Erstellt / Prepared Replacement for Überprüft / Reviewed Revision Page 2 of 2 Freigabe / Approval DVS vom / date
• Proven ability to synthesize complex data advanced technical skills related to data modelling, data mining, database design and performance tuning
• English language proficiency