Azure Data Engineer -Databricks

Overview

Job description:

Job Description  

Location: Hyderabad | Experience: 5–7 Years

We are looking for a Senior Data Engineer with strong experience in Azure Databricks to design, build, and optimize scalable data pipelines using modern Lakehouse and Medallion architectures.

Key Responsibilities

• Build and optimize data pipelines using Azure Databricks, Spark, Delta Lake
• Develop notebooks for data ingestion, transformation, and enrichment
• Implement dimensional data models and data marts for analytics
• Ensure data quality, performance, security, and governance
• Collaborate with architects, analysts, and agile teams

Must-Have Skills

• Azure Databricks, Spark / Spark SQL, Delta Tables
• Medallion & Lakehouse architecture
• ELT orchestration and notebook-based development
• Data modeling and data mart design
• AI-assisted development / Prompt engineering
• Strong analytical and communication skills

Good to Have

• Healthcare payer / claims data exposure
• Power BI (DAX, M Query)
• CI/CD for Databricks pipelines
• Unity Catalog & Service Principal–based access control

͏

Do

1. Instrumental in understanding the requirements and design of the product/ software

• Develop software solutions by studying information needs, studying systems flow, data usage and work processes
• Investigating problem areas followed by the software development life cycle
• Facilitate root cause analysis of the system issues and problem statement
• Identify ideas to improve system performance and impact availability
• Analyze client requirements and convert requirements to feasible design
• Collaborate with functional teams or systems analysts who carry out the detailed investigation into software requirements
• Conferring with project managers to obtain information on software capabilities

͏

2. Perform coding and ensure optimal software/ module development

• Determine operational feasibility by evaluating analysis, problem definition, requirements, software development and proposed software
• Develop and automate processes for software validation by setting up and designing test cases/scenarios/usage cases, and executing these cases
• Modifying software to fix errors, adapt it to new hardware, improve its performance, or upgrade interfaces.
• Analyzing information to recommend and plan the installation of new systems or modifications of an existing system
• Ensuring that code is error free or has no bugs and test failure
• Preparing reports on programming project specifications, activities and status
• Ensure all the codes are raised as per the norm defined for project / program / account with clear description and replication patterns
• Compile timely, comprehensive and accurate documentation and reports as requested
• Coordinating with the team on daily project status and progress and documenting it
• Providing feedback on usability and serviceability, trace the result to quality risk and report it to concerned stakeholders

͏

3. Status Reporting and Customer Focus on an ongoing basis with respect to project and its execution

• Capturing all the requirements and clarifications from the client for better quality work
• Taking feedback on the regular basis to ensure smooth and on time delivery
• Participating in continuing education and training to remain current on best practices, learn new programming languages, and better assist other team members.
• Consulting with engineering staff to evaluate software-hardware interfaces and develop specifications and performance requirements
• Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code
• Documenting very necessary details and reports in a formal way for proper understanding of software from client proposal to implementation
• Ensure good quality of interaction with customer w.r.t. e-mail content, fault report tracking, voice calls, business etiquette etc
• Timely Response to customer requests and no instances of complaints either internally or externally

͏

Deliver

1.Continuous Integration, Deployment & Monitoring of Software100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan2.Quality & CSATOn-Time Delivery, Manage software, Troubleshoot queries, Customer experience, completion of assigned certifications for skill upgradation3.MIS & Reporting100% on time MIS & report generation

Experience: 3-5 Years .

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.