Data Engineer

This role requires strong expertise in data warehousing, ETL processes, and cloud-based data solutions.

Key Responsibilities:

• Design, build, and maintain robust and scalable data pipelines for data ingestion, transformation, and loading from various sources into our data warehouse.
• Develop and optimize ETL/ELT processes using appropriate tools and technologies.
• Work extensively with PostgreSQL for data storage, querying, and optimization.
• Manage data infrastructure on AWS EC2 and leverage other AWS services (e.g., S3, RDS) for data storage and processing.
• Ensure data quality, consistency, and reliability across all data pipelines and datasets.
• Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver actionable insights.
• Implement monitoring and alerting for data pipelines to ensure data integrity and system health.
• Troubleshoot and resolve data-related issues, optimizing queries and data models for performance.
• Contribute to data governance, security, and compliance best practices.
• (Good to have): Experience with serverless functions (AWS Lambda/Google Cloud Functions) for event-driven data processing.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related quantitative field.
• 3-4 years of professional experience in data engineering.
• Strong proficiency in SQL, especially with PostgreSQL.
• Proven experience building and maintaining data pipelines.
• Hands-on experience with AWS services, particularly EC2, and familiarity with other relevant services (S3, RDS, Glue, Redshift etc.).
• Experience with scripting languages (e.g., Python, Node.js) for data manipulation and automation.
• Understanding of data warehousing concepts, data modeling, and ETL/ELT processes.
• Experience with big data technologies (e.g., Apache Spark, Hadoop) is a plus.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• (Good to have): Experience with AWS Lambda or Google Cloud Functions for data processing.