Data Engineer II - Real time streaming

About The Team

When 5% of Indian households shop with us, it’s important to build data-backed, resilient systems to manage millions of orders every day. We’ve done this – with zero downtime! 😎 Sounds impossible? Well, that’s the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over perfection, and see failures as opportunities to become better. We’ve taken steps to inculcate a strong ‘Founder’s Mindset’ across our engineering teams, making us grow and move fast. We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. As Software Development Engineer SDE II Data-Real Time Streaming, you’ll be part of self-starters who thrive on teamwork and constructive feedback. We know how to party as hard as we work! If we aren’t building unparalleled tech solutions, you can find us debating the plot points of our favourite books and games – or even gossiping over chai. So, if a day filled with building impactful solutions with a fun team sounds appealing to you, join us.

About The Role

Does digging deep for data and turning it into useful, impactful insights get you excited? Then you could be our next SDE II Data-Real Time Streaming. In this role, you’ll oversee your entire team’s work, ensuring that each individual is working towards achieving their personal goals and Meesho’s organisational goals. Moreover, you’ll keep an eye on all engineering projects and ensure the team is not straying from the right track. You’ll also be tasked with directing programming activities, evaluating system performance, and designing new programs and features for smooth functioning.

What You Will Do

• Build a platform for ingesting and processing multi terabytes of data daily
• Curate, build and transform raw data into scalable information
• Create prototypes and proofs-of-concept for iterative development
• Reduce technical debt with quality coding
• Keep a closer look at various projects and monitor the progress
• Carry on smooth collaborations with the sales team and engineering teams
• Provide management mentorship which sets the tone for holistic growth
• Ensure everyone is on the same page and taking ownership of the project
  
  
  

What You Will Need

• Bachelor’s/Master’s degree in Computer Science
• At least 1 to 3 years of professional experience
• Exceptional coding skills using Java, Scala, Python
• Working knowledge of Redis, MySQL and messaging systems like Kafka
• Knowledge of RxJava, Java Springboot, Microservices architecture
• Hands-on experience with the distributed systems architecture dealing with high throughput.
• Experience in building streaming and real-time solutions using Apache Flink/Spark Streaming/Samza.
• Familiarity with software engineering best practices across all stages of software development
• Expertise in Data system internalsStrong problem-solving and analytical skills
• Familiarity with Big Data systems (Spark/EMR, Hive/Impala, Delta Lake, Presto, Airflow, Data Lineage) is an advantage
• Familiarity with data modeling, end-to-end data pipelining, OLAP data cubes and BI tools is a plus
• Experience as a contributor/committer to the Big data stack is a plus
• Having been a contributor/committer to the big data stack
• Data modeling experience and end-to-end data pipelining experience is a plus
• Brownie points for knowledge of OLAP data cubes and BI tools