Associate Data Engineer

Overview

IDC is looking for a Junior Data Engineer to join our TechMatch team in Bangalore, India. In this role, you will utilize cutting-edge cloud solutions to collect, import, load, clean, integrate, and process data from a variety of large datasets. You will also contribute to designing and building scalable data pipelines that enhance our products, helping technology vendors better understand their markets, customers, and competitors.

Responsibilities

• Collaborate closely with market analysts, domain experts, and data science teams to develop data models and cloud-based pipelines for market research, reporting, and generative AI use cases.
• Use data to build and maintain up-to-date datasets that solve business problems, answer analytical questions, and improve processes.
• Support scalable data sharing and integration best practices across systems and teams.
• Define and implement metrics, guidelines, and strategies to ensure the effective use of data and algorithms.
• Perform regular data validation and quality checks, identify data inconsistencies or gaps, and recommend corrective actions.
• Design, build, and maintain ETL frameworks and infrastructure to collect, ingest, clean, integrate, and process data from multiple internal and external sources using SQL and AWS technologies.
  
  

• Bachelor’s degree or equivalent in Computer Science, Data Science, Information Technology, Mathematics, or a related field.
• 1+ year of experience in data engineering or closely related roles.
• Strong technical proficiency in object-oriented programming using Python.
• Solid analytical skills with experience handling unstructured datasets.
• Good working knowledge of SQL and relational databases.
• Ability to work independently and consistently deliver accurate, high-quality results on time.
• Strong verbal and written communication skills in English.
• Willingness and ability to learn new technologies and tools.
  
  

• Exposure to or experience with Machine Learning concepts or applications.
• Experience with data engineering in cloud-based environments.
• Familiarity with the AWS ecosystem and cloud services.
• Hands-on experience with data platforms and tools such as Snowflake, PostgreSQL, Airflow, NoSQL databases, or distributed computing frameworks.
  
  

?

IDC is the most respected global technology market research firm. We are changing the way the world thinks about the impact of technology on business and society. Our people, data, and analytics create global technology insights that accelerate customer success. IDC has been recognized for five consecutive years (2020, 2021, 2022, 2023, 2024) by the IIAR as the Analyst Firm of the Year which is one of the highest accolades for the technology market research industry.

Our collaborative, innovative and entrepreneurial culture is the perfect place for you to discover your future.

IDC is committed to providing equal employment opportunities for all qualified persons. Employment eligibility verification required. We participate in E-Verify.