Azure Data Engineer (NA)

Company Description

Company Description

Our culture is defined by our values and our deep commitment to help our clients succeed. We are a division of the 38th largest company in the world and bring to bear the strength of a very large network of interconnected Hitachi companies. At the same time we remain absolutely committed to the nimble agility that helped us grow Hitachi Solutions from three founding partners to nearly 2,000 consultants, developers and support personnel all around the globe.

Hitachi Solutions is a leader in providing industry solutions based on Microsoft Dynamics AX and Microsoft Dynamics CRM. Hitachi Solutions provides its customers with industry focus, software industry domain expertise, and proven tier-1 people. Hitachi Solutions works with its customers to understand their unique formula for success and develops solutions that improve their business and attain measurable results.2011, 2009, 2006 & 2005 Microsoft Dynamics Partner of the Year (Finalist 2008, 2007). Microsoft Global Dynamics Award (Global Dynamics Partner of the year) 2014.

Hitachi Solutions is a core IT company of the Hitachi Group, which employs some 400,000 people worldwide. Through systems integration, we provide ideal solutions and products for customers. Headquartered in Tokyo, Japan, Hitachi Solutions' reach extends to group companies in Japan and abroad, working with a worldwide network of alliance partners. We bring solutions and products to diverse countries and regions including Asia, the United States and Europe. The flagship company in the Hitachi Group's information and communication system solutions business, Hitachi Solutions also offers solutions for social innovation such as smart cities.

For more information on Hitachi Solutions, please visit: https://web.hitachi-solutions.com

Job Description


JD Title : Data Engineer

Experience level : 5+ Yeras

Requirements:

• 5+ years of full-time experience as an Azure Data Engineer, with extensive knowledge of ADF, ADLS, Databricks, and Synapse
• Able to quickly write SQL for database querying and DAX for creating custom calculations
• Able to develop Extraction pipelines to load the data using ADF or comparable technologies and Transformation and Load pipelines using ADF and Databricks
• Able to design a storage solution on ADLS utilizing Parquet and Delta table formats
• Able to design star-schema data models in ADLS, Azure SQL, and Synapse databases
• Understand data modeling concepts and be able to create effective data models to support reporting needs
• Perform data ETL processes to ensure that data sets are clean, accurate, and ready for analysis
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines
• Monitor and resolve data pipeline problems to ensure consistency and availability of the data
• Unwavering ability to quickly propose solutions by recalling the latest best practices learned from MVP & Product Team articles, MSFT documentation, whitepapers, and community publications
• Work closely with stakeholders to understand requirements, deliver solutions that meet those needs, and bridge the gap between technical and non-technical sides
• Excellent communication, presentation, influencing, and reasoning skills

Primary Skills:

• Data Engineering: Extensive knowledge in Azure SQL, T-SQL, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse/Data Warehouse, SSIS, Key Vaults, Azure Functions, Azure Logic Apps, etc
• Data Modeling: Design data models for ETL and reporting needs based on the requirements gathered and data discovery conducted in the source systems
• Experience working in Agile environments with continuous integration and continuous deployment and application lifecycle management - experience in DevOps CI/CD repos and pipelines, and GitHub or Bitbucket
  Secondary Skills:
• Experience in detailed design aspects in Azure, including design patterns and principles
• Experience with performance tuning of data processing pipelines and cloud-based applications
• Experience in setting up and administering DevOps and GitHub or other automation tools like Jenkins/Puppet/ Ansible/Terraform
• Possess good knowledge of M, Vertipaq Analyzer, and Power BI Service architecture design and administration
• Certifications in Microsoft Azure, Data Analytics.

Qualifications

Additional Information

Beware of scams

Our recruiting team may communicate with candidates via our @hitachisolutions.com domain email address and/or via our SmartRecruiters (Applicant Tracking System) notification@smartrecruiters.com domain email address regarding your application and interview requests.

All offers will originate from our @hitachisolutions.com domain email address. If you receive an offer or information from someone purporting to be an employee of Hitachi Solutions from any other domain, it may not be legitimate.