Sr. Data Engineer- AWS- Big Data

Position: Sr. Data Engineer- AWS- Big Data

Purpose of the Position:
You will be a critical member of the Infocepts Cloud Data Architect Team. This position requires a sound knowledge on Big Data using Cloud technologies, EMR, Athena, PySpark, S3, AWS Lambda etc. Strong foundation on database concepts and SQL is also required.

Location: Nagpur/Pune/Chennai/Bangalore

Type of Employment: Full-time

Key Result Areas and Activities:

Technology Assessment and Design:

• Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
• Should be able to design complex Big Data use cases using AWS Services under guidance of Architect.
• Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance & durability.
• Should be able to suggest optimizations in existing designs.
• Ensure optimal balance between cost and performance.

Documentation and Stakeholder Communication:

• Project documentation, adheres to quality guidelines & schedules.
• Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
• Articulate design decisions very clearly with stakeholders.
• Perform Proof-of-Concepts and document all observations before proposing a new solution.
• Conduct design review sessions with other teams and identify scope of improvement.

Process Improvement and Automation:

• Suggests automation to improve existing processes.
• Assist junior Data Engineers by providing expert advice or troubleshooting steps whenever required.
• Keep suggesting new ways to improve team productivity.

Training and Knowledge Sharing:

• Create technology-focused training plans whenever required.
• Deliver technology-focused training sessions with team members whenever required.
• Conduct Expert Knowledge Sharing sessions with Client Stakeholders whenever required.
• Assist in designing case study documents whenever required.