Senior Data Engineer

Overview

Job Summary:

We are seeking a skilled Data Engineer to join our data team. You will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics, machine learning, and business intelligence. The ideal candidate has strong programming skills, a deep understanding of database systems, and experience working with big data technologies.

Key Responsibilities:

• Design, build, and maintain robust, scalable, and high-performance data pipelines.
• Develop and optimize data models, schemas, and storage systems (e.g., data warehouses, lakes).
• Integrate data from multiple sources (APIs, databases, logs, etc.) into centralized systems.
• Collaborate with data analysts, scientists, and business stakeholders to understand data needs.
• Ensure data quality, reliability, and integrity across all data platforms.
• Implement data governance practices, including security, privacy, and compliance controls.
• Monitor pipeline performance and troubleshoot issues in production environments.
• Work with cloud platforms (e.g., AWS, GCP, Azure) to deploy and manage data infrastructure.
• Create and maintain documentation related to data architecture and workflows.

Required Skills & Qualifications:

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
• 5+ years of experience as a Data Engineer or in a similar role.
• Proficiency in SQL and experience with relational and NoSQL databases (e.g., PostgreSQL, MongoDB).
• Strong programming skills in Python, Scala, or Java.
• Experience with data pipeline tools like Apache Airflow, Luigi, or similar.
• Familiarity with big data technologies like Spark, Hadoop, Kafka.
• Hands-on experience with cloud data services (e.g., AWS Redshift, GCP BigQuery, Azure Data Factory).
• Knowledge of ETL/ELT processes and best practices.
• Understanding of data warehousing concepts and dimensional modeling.

Preferred Qualifications:

• Experience with containerization (Docker, Kubernetes).
• Knowledge of CI/CD practices for data pipeline deployments.
• Experience with version control systems like Git.
• Familiarity with data cataloging and lineage tools.
• Exposure to machine learning workflows and MLOps.

If interested, please share your updated resume to dhina@datatechgenius.com

Best Regards,
Dinagaran Veera
Business Development Manager
91 8610069574

dhina@datatechgenius.com

Job Type: Contractual / Temporary
Contract length: 6 months

Schedule:

• Day shift
• Monday to Friday

Work Location: Remote