Senior Data Engineer

Overview

We are seeking a skilled and motivated Data Engineer to join our growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, ensuring the accuracy, accessibility, and security of data for analysis and decision-making. You will work closely with data scientists, analysts, and other engineers to deliver high-quality data solutions.

Key Responsibilities:

• Design and Build Data Pipelines: Develop, construct, install, and maintain scalable data pipelines to move and transform data from various sources to data storage solutions.
• Data Integration: Integrate and combine large sets of data from multiple sources for analysis, reporting, and business intelligence.
• Data Warehousing: Develop and maintain data warehousing solutions using SQL, cloud platforms (AWS, Google Cloud, Azure), and other ETL (Extract, Transform, Load) tools.
• Optimize Data Flow: Monitor and optimize the performance of data pipelines and storage systems to ensure smooth and efficient data processing.
• Collaboration: Work closely with data scientists, analysts, and other teams to ensure data infrastructure meets their needs for analysis and reporting.
• Data Quality & Security: Ensure the integrity, quality, and security of data, and troubleshoot issues related to data inconsistency or pipeline failures.
• Documentation: Document and maintain code and data infrastructure to ensure clarity and maintainability for current and future team members.
• Automation & Efficiency: Automate repetitive processes and improve the overall efficiency of data management systems.

Skills and Qualifications:

• Technical Skills:
• Proficiency in programming languages such as Python, Java, Scala, or SQL.
• Experience with ETL tools (e.g., Apache Kafka, Apache Nifi, Talend) and data processing frameworks (e.g., Apache Spark, Hadoop).
• Strong experience in working with cloud platforms like AWS, Google Cloud, or Azure.
• Experience with data warehousing technologies such as Snowflake, Redshift, or BigQuery.
• Familiarity with database management systems (e.g., MySQL, PostgreSQL, NoSQL databases like MongoDB, Cassandra).
• Data Modeling & Architecture: Understanding of data modeling techniques and database architecture.
• Data Pipelines & Workflow Orchestration: Hands-on experience with workflow orchestration tools like Apache Airflow or similar.
• Version Control: Proficiency with version control systems like Git.
• Problem-Solving & Analytical Skills: Strong analytical skills with the ability to troubleshoot and solve complex data-related issues.
• Communication: Excellent communication skills to collaborate effectively with cross-functional teams.
• Education: Bachelor's degree in Computer Science, Engineering, Data Science, or a related field (Master’s preferred).

Job Types: Full-time, Permanent

Pay: ₹10,000.00 - ₹40,000.00 per month

Benefits:

• Paid time off

Schedule:

• Day shift
• Fixed shift
• Weekend availability

Work Location: In person