Python Data Engineer

Overview

Job Title : Python Data Engineer

Location : Remote

Contract duration : Long term

Are you a seasoned data engineer with a passion for both hands-on technical work? Do you thrive in an environment that values innovation, collaboration, and cutting-edge technologies? We are seeking an experienced Data Integration engineer to spearhead our data integration strategies and initiatives. The ideal candidate will possess deep technical expertise in Python programming, Snowflake data warehousing, AWS cloud services, Kubernetes (EKS), CI/CD methodologies, Apache Airflow, dbt, Kafka for real-time data streaming, and API development. This role is pivotal in driving the architecture, development, and maintenance of scalable and efficient data pipelines and integrations to support our analytics and business intelligence platforms.

Role and Responsibilities:

• As the Data Integration Engineer, you will play a pivotal role in shaping the future of our data integration engineering initiatives. You will remain actively involved in the technical aspects of the projects. Your responsibilities will include:
• Hands-On Contribution: Continue to be hands-on with data integration engineering tasks, including data pipeline development, EL processes, and data integration. Be the go-to expert for complex technical challenges.
• Integrations Architecture: Design and implement scalable and efficient data integration architectures that meet business requirements. Ensure data integrity, quality, scalability, and security throughout the pipeline.
• Tool Proficiency: Leverage your expertise in Snowflake, SQL, Apache Airflow, AWS, API, CI/CD, DBT and Python to architect, develop, and optimize data solutions. Stay current with emerging technologies and industry best practices.
• Data Quality: Monitor data quality and integrity, implementing data governance policies as needed.
• Cross-Functional Collaboration: Collaborate with data science, data warehousing, analytics, and other cross-functional teams to understand data requirements and deliver actionable insights.
• Performance Optimization: Identify and address performance bottlenecks within the data infrastructure. Optimize data pipelines for speed, reliability, and efficiency.
• Project Management: Oversee end-to-end project delivery, from requirements gathering to implementation. Ensure projects are delivered on time and within scope.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or related field. Advanced degree is a plus.
• 4 years of hands-on experience in python programming.
• 3 years of experience in data engineering with experience in SQL.

Preferred Skills:

• Familiarity with cloud platforms, such as AWS or Azure.
• Demonstrated experience in designing and developing RESTful APIs.
• Preferred experience with Snowflake, AWS, Kubernetes (EKS), CI/CD practices, Apache Airflow, and dbt.
• Good experience in full-stack development
• Excellent analytical, problem-solving, and decision-making abilities.
• Strong communication skills, with the ability to articulate technical concepts to non-technical stakeholders.
• A collaborative mindset, with a focus on team success.

Job Type: Contractual / Temporary
Contract length: 24 months

Pay: ₹2,500,000.00 - ₹3,000,000.00 per hour

Expected hours: 40 per week

Benefits:

• Work from home

Work Location: Remote