Data Engineer

Overview

About The Company:

ARA's client is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain and process expertise.

The Role:

Data Engineer

Key Responsibilities:

• Develop low level design as per approved Tech Specification or equivalent inputs provided.
• Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs.
• Build and delivery technology deliverables compliant with functional requirements.
• Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc.
• Process technology deliverables through full development lifecycle.
• Maintain and support existing solutions and technology frameworks.
• Attend regular scrum events of equivalent and provide update on the deliverables.
• Work independently with none or minimum supervision.

Skills Required:

• Developing ETL pipelines involving big data.
• Developing data processing\analytics applications primarily using PySpark.
• Experience of developing applications on cloud (AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.
• Clear understanding and ability to implement distributed storage, processing and scalable applications.
• Experience of working with SQL and NoSQL database.
• Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.
• Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries.
• Experience of developing applications that consume the services exposed as ReST APIs.

Qualifications & Experience:

• Any graduation
• 8+ years of experience

Job Types: Full-time, Permanent

Pay: ₹1,500,000.00 - ₹2,000,000.00 per year

Schedule:

• Day shift

Education:

• Bachelor's (Required)

Experience:

• Big data: 3 years (Required)
• Pyspark: 3 years (Required)
• ETL: 3 years (Required)
• AWS: 1 year (Required)
• Total work: 8 years (Required)

Location:

• Bangalore, Karnataka (Required)

Work Location: In person