Data Engineer

Overview

About the Role

The Data Engineer plays a critical role in developing and maintaining data engineering projects that support the organization’s data collection systems and processing pipelines. This role is responsible for writing efficient, scalable code to build optimized and highly available data pipelines, enabling deeper analysis and reporting by the Data & Analytics team. The Data Engineer collaborates with analysts and data scientists, leveraging tools such as Tableau, Python, and Spark to deliver impactful data solutions.

Key Responsibilities

Primary Responsibilities

• Minimum 2–3 years of hands-on experience in data engineering.
• Proven expertise in SQL, Spark, and the Hadoop ecosystem.
• Experience handling multiple terabytes of data from ingestion to consumption.
• Collaborate with business stakeholders to identify high-impact problems and potential data-driven solutions.
• Strong understanding of Data Lake/Lakehouse architecture.
• Exposure to Hadoop distributions (Cloudera, Hortonworks) and/or AWS.
• Manage the full data lifecycle: ingestion, transformation, and consumption.
• Proficient in working with APIs for data integration.
• Skilled in Spark, Spark Streaming, Hive, and SQL.
• Experience with big data infrastructure including MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.
• Deep knowledge of relational databases and data modeling.
• Technical debugging and troubleshooting skills.
• Use Git for version control and maintain clean, documented code.
• Prepare technical design documentation for data pipelines and projects.
  
  

Secondary Responsibilities

• Ability to work independently and manage personal development efforts.
• Strong oral and written communication skills.
• Learn and apply internal analytics technologies.
• Identify key performance indicators and develop strategies to achieve them.
• Use educational background in data engineering to perform data mining and analysis.
• Collaborate with BI analysts/engineers to build prototypes.
• Participate in the delivery and presentation of data solutions.
  
  

What We Are Looking For

Education

• Graduation: B.E or B.Tech in Computer Science or Information Technology or related field.
• Post-graduation: M.Tech preferred.
  
  

• 2 to 5 years of relevant experience in data engineering.
• Experience in sales-related data projects is a plus.
  
  

Skills and Attributes

• Strong coding and debugging skills.
• Proficiency in big data tools and cloud platforms.
• Ability to work with large datasets and complex data architectures.
• Effective communication and stakeholder engagement.
• Self-driven with a continuous learning mindset.
• Strong documentation and organizational skills.