Data Engineer-Dataiku/Python

Position: Data Engineer (Python/Dataiku/Spark/SAS DI)

Location: Bangalore/Chennai

Type of Employment: Full time

Purpose of the Position:

As a Data Engineer, this position requires candidate who are enthusiastic about specialized skills in any DE tools like Python/Dataiku/Spark/SAS DI and features. As a member of the team, you will help our clients, by building data pipelines that supports to progress on their Data and Analytics journey.

Key Result Areas and Activities:

Driving Data Engineering Initiatives:

• Work with clients to understand and define the data initiatives based on business needs.
• Review all project architectures/codes and contribute towards the development of the project delivery.

Data Integration and ETL Development:

• Design, develop, and implement data integration solutions using Data Engineering tools like Python/Dataiku/Spark/SAS data integration.
• Develop and maintain automated data pipelines for real-time and scheduled data ingestions.

Performance Tuning and Optimization:

• Conduct performance tuning and optimization of queries and data models.
• Optimize data workflows for efficiency and scalability.

Database Design and Implementation:

• Design and implement database objects such as tables, views, schemas, and stored procedures.
• Ensure data quality and consistency across the data warehouse.

Collaboration and Communication:

• Work closely with cross-functional teams to gather requirements and translate them into technical specifications.
• Collaborate seamlessly with clients across multiple geographies.

Problem Solving and Troubleshooting:

• Troubleshoot and resolve data-related issues.
• Apply strong analytical and problem-solving abilities to ensure data quality.

Drive the Project & Technical Team:

• Work with client to gather the data requirements.
• Provide required technical support to development team while delivering the code/project.
• Manage end to project deliverables as technical lead/spoc for client and Infocepts.