Ingrain Systems Inc - Data Engineer - Data Pipeline/Data Modeling

Overview

Others/Hyderabad, Telangana, India

Company : INGRAIN SYSTEMS PRIVATE LIMITED

Job Description

We are seeking a highly motivated and experienced Data Engineer to join our growing team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines that enable our data scientists and business analysts to extract valuable insights from our data. You will work with a variety of data sources, technologies, and tools to ensure the quality, integrity, and accessibility of our data.

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using various ETL tools and technologies.
• Build and optimize data models for data warehousing and data lake solutions.
• Implement data quality checks and monitoring systems to ensure data accuracy and consistency.
• Collaborate with data scientists, business analysts, and other stakeholders to understand data requirements and deliver effective solutions.
• Develop and maintain documentation for data pipelines, data models, and data quality processes.
• Troubleshoot and resolve data-related issues in a timely manner.
• Stay up-to-date with the latest trends and technologies in data engineering.
• Contribute to the development of data engineering best practices and standards.
• Automate data processing tasks and improve the efficiency of data pipelines.
• Work with cloud-based data platforms (e.g., AWS, Azure, GCP).
• Implement data security and privacy measures to protect sensitive data.
  
  

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Experience : 3-8 years of experience in data engineering.
• Strong understanding of data warehousing concepts and principles.
• Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL, SQL Server).
• Experience with ETL tools and technologies (e.g., Apache Spark, Apache Kafka, Apache Airflow, Informatica, Talend).
• Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
• Experience with data modeling and data schema design.
• Strong programming skills in Python or Java.
• Experience with data quality and data governance practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
  
  

• Experience with NoSQL databases (e.g., MongoDB, Cassandra).
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Experience with machine learning pipelines.
• Experience with DevOps practices and tools.
• Experience with big data technologies (e.g., Hadoop, Hive, Pig).
  
  

• Competitive salary and benefits package.
• Opportunity to work on challenging and impactful projects.
• Collaborative and supportive work environment.
• Opportunities for professional development and growth.
  
  

(ref:hirist.tech)