Data Engineer II

Do you have a relentless passion for data engineering and building platforms that enable decision science at scale? Does processing petabytes of data every day excite you? Do you enjoy designing complex workflows and pipelines that power measurement, insights, and visualization from real-world user data—ultimately driving experiments and recommendations that impact business metrics? If so, we’d love to talk to you!

We are the Windows India Data team, part of the Windows and Web Experiences (WWE) engineering organization. Our mission is to leverage advanced data engineering, analytics, and data science to inform decision-making, drive product performance, and maximize business impact through the power of ML/AI. In short, we thrive on data to solve high-impact business problems for Windows! We’re looking for a strong Data Engineer to help us foster and scale a data-driven culture across Windows.

As a Software & Data Engineer II, you’ll help build and deliver business intelligence for experiences running on 1.5 billion Windows devices. You’ll partner closely with Data Scientists and Analysts to understand their challenges and design next-generation platforms and solutions that make decision-making seamless and scalable.

Responsibilities

• Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
• Data extraction across a wide variety of data sources.
• Data cleaning, preprocessing, and transformation for further analysis by data analysts.
• Data Validation framework from source to endpoints ensuring data quality and integrity.
• Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
• Contribute to a data-driven culture as well as a culture of experimentation across the organization.
• Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
• Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  
  

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.
• Proven coding and debugging skills in C#, C++, Java, or SQL.
• Ability to work and communicate effectively across disciplines and teams.
• Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
• 2+ years of experience in data engineering.
• Understanding and experience with data cloud computing technologies such as – Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer, Power BI, PowerApps, Hadoop, YARN, Apache Spark.
• Excellent analytical skills with systematic and structured approach to software design.
  

#W+DJOBS

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.