SENIOR DATA ENGINEER - DATA

Job Description

Lead data engineer with 8 years of experience Expertise in Spark Spark Streaming Minimum 6 years of experience designing developing testing and implementing ETL solutions using any enterprise ETL tools Expertise in design and building big data platforms with real near real-time data pipelines Understand the Spark architecture and hands-on experience in implementing Spark design patterns with Spark optimization Competence in working with various data formats including JSON Parquet Delta and CSV using Databricks Strong coding skills in Python PySpark with hands on experience in implementing OOPs concepts Leverage AWS platform to design and develop solutions for building Data platform Proficient in data architecture. Should be able to work independently in data analysis Strong handson SQL experience and exposure in working with NoSQL Technical Skills: Primary Strong Coding and Designing Skill Databricks PySpark, Spark Streaming Python SQL Secondary Hadoop Terraform Data Science exposure