Information Technology
Full-Time
RAPSYS TECHNOLOGIES PTE LTD
Overview
Responsibilities
Requirements
Preferred Qualifications
- Design, develop, and maintain complex data pipelines using Python for efficient data
- Collaborate with cross-functional teams to understand data requirements and
- Implement data integration and transformation processes to ensure optimal
- Optimize and fine-tune existing data pipelines / Airflow to improve efficiency,
- Troubleshoot and resolve issues related to data pipelines, ensuring smooth
- Work closely with AWS services like S3, Glue, EMR, Redshift, and other related
- Develop and maintain documentation for data pipelines, processes, and system
- Stay updated with the latest industry trends and best practices related to data
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proficiency in Python, PySpark and SQL for data processing and manipulation.
- Min 5 years of experience in data engineering, specifically working with Apache
- Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS
- Understanding of Snowflake Data Lake is preferred.
- Experience with optimizing and scaling data pipelines for performance and
- Good understanding of data modeling, ETL processes, and data warehousing
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative
- Effective communication skills and the ability to articulate technical concepts to
Preferred Qualifications
- AWS certification(s) related to data engineering or big data.
- Experience working with big data technologies like Snowflake, Spark, Hadoop, or
- Familiarity with other data orchestration tools in addition to Apache Airflow.
- Knowledge of version control systems like Bitbucket, Git.
Similar Jobs
View All
1 Day ago
Onsurity - Web Developer - Frontend Technologies
Information Technology
Role OverviewWere looking for a Web Developer with a marketing mindset - someone whos equally comfortable building landing pages as they are integrating tools and optimizing performance.Youll work closely with the marketing and tech teams to build a...
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
1 Day ago
Senior Data Analyst (Fixed term 24 months)
Information Technology
V ABB pomáháme průmyslovým odvětvím být o krok napřed. U nás je pokrok samozřejmostí - pro vás, váš tým i celý svět. Jako světová jednička na trhu vám poskytneme to, co potřebujete, abyste toho dosáhli. Nebude to vždy snadné, růst vyžaduje odvahu. A...
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
1 Day ago
Azure Databricks/Senior Business Analyst
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
1 Day ago
Fusion Practices - SQL Developer - Data Warehousing
Information Technology
About The RoleFusion Practices is looking for a highly skilled SQL Developer with large-scale data warehouse environments.ResponsibilitiesThe ideal candidate will bring strong expertise in Microsoft SQL Server, Power BI, along with hands-on exposure...
1 Day ago
Senior Network Operations Engineer
Information Technology
Job DescriptionIn this role you will: Identifying actionable incidents using a monitoring system, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with...
1 Day ago
Python Data Analyst (Projects-Based Internship)
Information Technology
Python Data Analyst (Projects-Based Internship) Are you ready to kickstart your data analytics journey with hands-on, real-world projects? 🚀 We are offering a 1-Month Python Data Analyst Internship where students and freshers will gain industry-leve...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in