Senior Python ETL Developer/Lead

Job Title: Senior Python ETL Developer/Lead

Job Type: 6 Months + Extendable

Experience : 5 to 6 years

Job Description:

We are seeking an experienced Senior ETL Developer/Lead to join our team. The ideal candidate will have a strong background in developing ETL processes using Python and open-source tools/libraries, including PySpark and Apache Airflow. This position requires a hands-on developer who can design, implement, and maintain robust ETL solutions and lead a team of developers.

Key Responsibilities:

• Design, develop, and maintain ETL processes to support data integration and data warehousing.
• Lead a team of ETL developers, providing technical guidance and mentoring.
• Collaborate with data architects, business analysts, and other stakeholders to gather requirements and design solutions.
• Utilize open-source tools and libraries, including PySpark, to enhance ETL processes.
• Optimize and troubleshoot ETL processes to ensure timely and accurate data load.
• Develop and implement best practices for ETL development and data management.
• Perform data quality checks and validations to ensure data integrity.
• Create and maintain comprehensive ETL documentation.
• Stay updated with the latest trends and advancements in ETL and data integration technologies.
• Contribute to continuous process improvement initiatives.

Requirements:

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• 5+ years of experience in ETL development using Python.
• Experience with open-source ETL tools and libraries such as Apache Airflow, PySpark, and Pandas.
• Experience in development of database processes using Oracle SQL, PL/SQL
• UNIX and/or Windows environments
• Scripting such as Shell, Perl
• Object Oriented Analysis and Design (OOAD)
• Service Oriented Architecture (SOA)
• Strong understanding of data warehousing concepts, data modeling, and data integration.
• Excellent problem-solving skills and attention to detail.
• Ability to lead and mentor a team of developers.
• Strong communication and collaboration skills.

Preferred Qualifications:

• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Familiarity with version control systems (e.g., Git).
• Experience in Agile/Scrum development methodologies.