Data Engineer

Job Description

Job Summary:

We are looking to backfill a Data Engineer role with over 3 years of experience in Big Data technologies. The ideal candidate will be proficient in Scala Spark or PySpark, experienced with Databricks, and have strong SQL skills. Exposure to Snowflake, LLMs/Generative AI, and experience in the retail domain will be considered a strong advantage. The candidate should also possess strong analytical thinking and problem-solving abilities.

Key Responsibilities:

• Design, develop, and optimize scalable data pipelines using Spark (Scala or PySpark)
• Work within the Databricks environment to manage and process large-scale datasets
• Collaborate with data scientists, analysts, and other engineers to support data-driven initiatives
• Integrate and manage data across various sources including Snowflake
• Write efficient and optimized SQL queries for data extraction and transformation
• Contribute to the development and deployment of AI/ML solutions, especially those involving MLs or GenAI
• Ensure data quality, integrity, and governance across all pipelines
• Leverage Azure Cloud services for data storage, processing, and orchestration
  
  

Qualifications

• 3+ years of experience in Big Data engineering
• Strong programming skills in Scala Spark
• Solid command of SQL for data manipulation and analysis
• Hands-on experience with Databricks on Azure
• Exposure to Snowflake data warehousing
• Solid understanding of data modeling, ETL processes, and performance tuning
  
  

Additional Information

Our Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)
  
  

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on: LinkedIn | Instagram | Twitter | Facebook

Our commitment to Diversity, Equity, and Inclusion

NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion