Free cookie consent management tool by TermsFeed Azure Data Integration Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Azure Data Integration Engineer

decor
Information Technology
Full-Time
ITC Worldwide

Overview

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.

This position requires extensive SQL experience and a strong background in PySpark development.

Responsibilities

Data Engineering:

  • Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
  • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
  • Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
  • Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.


Documentation:

  • Document ticket resolutions, testing protocols, and data validation processes.
  • Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.


Ticket Management:

  • Monitor the Jira ticket queue and respond to tickets as they are raised.
  • Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
  • Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks) as needed to resolve issues.


Troubleshooting and Support:

  • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
  • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.


Desired Skills & Requirements

Seeking a candidate with 5+ years of Dynamics 365 ecosystem experience with a strong PySpark development background. While various profiles may apply, we highly value a strong person-organization fit.

Our ideal candidate possesses the following attributes and qualifications:

  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within the customers secure environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
  • Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
  • Experience with Data Engineering in Microsoft Fabric
  • Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks).
  • Certifications in Azure Data Engineering.


Why Join Us?

  • Opportunity to work with innovative technologies in a dynamic environment where progressive work culture with a global perspective where your ideas truly matter, and growth opportunities are endless.
  • Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
  • Enjoy the flexibility to work from anywhere
  • Work-life balance that suits your lifestyle.
  • Competitive salary and comprehensive benefits package.
  • Career growth and professional development opportunities.
  • A collaborative and inclusive work culture.
Share job
Similar Jobs
View All
13 Hours ago
MERN Stack Developer - Remote
Information Technology
  • 2 - 4 Yrs
  • Anywhere in India/Multiple Locations
Job responsibility: Hire and mentor a team of high-calibre front-end and Backend engineers Design and develop new user-facing full-stack applications. Building reusable components and front-end, backend libraries for future use Optimizing...
decor
1 Day ago
ScaleUp Technologies - Software Engineer - Golang
Information Technology
  • Bangalore, Karnataka, India
Skills Experience in modern RESTful API development In-depth expertise in microservices, Docker and Kubernetes Strong knowledge in software architecture, data structures / design patterns Strong knowledge of Go programming language, paradigms, c...
decor
1 Day ago
Republic World - Junior DevOps Engineer - Google Cloud Platform
Information Technology
  • Bangalore, Karnataka, India
DevOps Engineer (2 - 5 Years Exp.) | NoidaLocation : Sector 158, Noida | On-site Description : Are you a seasoned DevOps Engineer with 2-5 years of experience, ready to take ownership of large-scale infrastructure and cloud deployments?We're looking...
decor
1 Day ago
ScaleUp Technologies - .Net Developer - C#/Javascript
Information Technology
  • Gurugram, Haryana, India
Job DescriptionWe are looking for a highly skilled and versatile .NET Developer to join our engineering team. The ideal candidate will have a strong foundation in .NET Core and C#, experience with modern frontend frameworks, and a passion for buildi...
decor
1 Day ago
Interesting Job Opportunity: Azure Architect
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionThe Azure Architect will offer technical leadership in Microsoft Cloud, Azure, and Azure DevOps. include overseeing new implementations, cloud migrations, DevOps practices, governance, and platform strategy, as well as delivering cust...
decor
1 Day ago
FINVASIA - Linux System Administrator - Virtualization
Information Technology
  • Bangalore, Karnataka, India
Job SummaryWe are looking for a knowledgeable and proactive Linux System and Networking Administrator with strong experience in virtualization (especially Proxmox and VMware vCenter) and a deep understanding of enterprise networking.You will be resp...
decor
1 Day ago
Republic World - Junior DevOps Engineer - Cloud Environment
Information Technology
  • Bangalore, Karnataka, India
We're Hiring | Junior DevOps Engineer (2-5 Years Exp)Location : Noida | Immediate Joiners PreferredWe are looking for a Junior DevOps Engineer with 2-5 years of experience to join our team and support our deployment processes and infrastructure.This...
decor
1 Day ago
Technical Lead - PHP
Information Technology
  • Bangalore, Karnataka, India
Tech Lead PHP (Laravel / Phalcon + Full Stack)Location : Ahmedabad.Experience : 68 Years.Job DescriptionWere looking for a Tech Lead who will actively do R&D, code hands-on, mentor developers, and drive the technical direction of our product platfor...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media