Data Engineer

Overview

This is your opportunity to develop your career with an exciting, fast paced and rapidly expanding business, one of the leading providers of Business Intelligence worldwide. As a Database Engineer with excellent database development skills, you will be responsible for developing and maintaining the databases and scripts that power the company’s products and websites, handling large data sets and having more than 20 million hits per day.

You will work with your team to deliver work on time, in-line with the business requirements, and to a high level of quality This is your opportunity to develop your career with an exciting, fast paced and rapidly expanding business, one of the leading providers of Business Intelligence worldwide.

You will work with your team to deliver work on time, in-line with the business requirements, and to a high level of quality.

Essential Skills

· Bachelor’s degree in computer science, Engineering, or a related field.

· 3 to 6 years of experience in data engineering, with a focus on AWS and Oracle technologies.

· Strong expertise in AWS services such as S3, Redshift, Glue, Athena, EMR and Airflow.

· Expertise in Oracle database technologies, including SQL, PL/SQL.

· Expertise in Python and Pyspark.

· Experience in Data Build Tool (DBT)

· Experience with data modeling, data warehousing, and data governance principles.

· Strong problem-solving and analytical skills.

· Excellent communication and collaboration skills

· Knowledge on Airflow DAGs is Mandatory.

· Knowledge on API’s , Postman Collections is required.

· Knowledge on CI/CD Processes , should be able to Build Pipelines for release processes.

· Good experience in loading and extracting large data sets.

· Analytical and critical thinking skills; agile problem-solving abilities.

· Detail oriented, self-motivated, able to work independently with little or no supervision, and is committed to the highest standards of quality for the entire release process.

· Excellent written and verbal communication skills.

· Attention to detail.

· Ability to work in a fast paced / changing environment.

Responsibilities

· Write code for new development requirements as well as provide bug fixing, support and maintenance of existing code.

· Design, develop, and implement data solutions using AWS, Python and Oracle technologies.

· Collaborate with cross-functional teams to gather requirements and define data engineering solutions.

· Develop and maintain data pipelines and data integration workflows.

· Optimize and tune data solutions for performance and scalability.

· Ensure data quality and integrity through data validation and cleansing processes.

· Monitor and troubleshoot data engineering processes to identify and resolve issues.

· Assist the business in the collection and documentation of user's requirements where needed, provide estimates and work plans

· Create and maintain technical documentation.

· Follow all company procedures/standards/processes.

· Contribute to architectural design and development making technically sound development recommendations.

· Provide support to other staff in the department and act as a mentor to less experienced staff, including through code reviews.

· Work as a team player in an agile environment.

· Build release scripts and plans to facilitate the deployment of your code to testing and production environments.

· Take ownership of any issues that occur within your area to ensure an appropriate solution is found

· Assess opportunities for application and process improvement and share with team members and/or affected parties

Job Types: Full-time, Permanent

Pay: ₹501,897.21 - ₹1,852,033.63 per year

Benefits:

• Flexible schedule
• Health insurance
• Internet reimbursement
• Life insurance
• Provident Fund
• Work from home

Work Location: In person