Azure Data Engineer with Databricks

Overview

Experience- 9+ years

Location: Pune, Hyderabad (Preferred)

JD-

• Experience in Perform Design, Development & Deployment using Azure Services ( Data Factory, Azure Data Lake Storage, Databricks, PySpark, SQL)
• Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity.
• Experience in create the Technical Specification Design, Application Interface Design.
• Files Processing – XML, CSV, Excel, ORC, Parquet file Formats
• Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data
• Good to have experience with ETL development both on-premises and in the cloud using SSIS, Data Factory, and related Microsoft and other ETL technologies (Informatica preferred)
• Demonstrated in depth skills with Azure Data Factory, Azure Databricks, PySpark, ADLS (must have) with the ability to configure and administrate all aspects of Azure SQL DB.
• Collaborate and engage with BI & analytics and business team
• Deep understanding of the operational dependencies of applications, networks, systems, security and policy (both on premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.),

Job Types: Full-time, Permanent

Pay: From ₹1,500,000.00 per year

Schedule:

• Fixed shift

Application Question(s):

• How many years of total experience do you currently have?
• How many years of experience do you have with Azure data services?
• How many years of experience do you have with Azure Databricks?
• How many years of experience do you have with PySpark?
• What is your current CTC?
• What is your expected CTC?
• What is your notice period/ LWD?
• Are you comfortable attending L2 interview face to face in Hyderabad or Pune office?
• What is your current and preferred location?