Principal Data Engineer

• Create and maintain optimal data pipeline architecture

• Brainstorm and create new platforms which will help in our quest to make data available to users in all shapes and forms, with low latency and horizontal scalability.

• Work with internal stakeholders to assist with data-related technical issues and support their data infrastructure needs.

• Make changes to our data platform, refactoring/redesigning as needed and diagnosing any problems across the entire technical stack.

• Design and develop a real-time events pipeline for Data ingestion for real-time dash-boarding.

• Develop complex and efficient functions to transform raw data sources into powerful, reliable components.

• Monitor job performances, file system/disk-space management, cluster & database connectivity, log files, management of backup/security and troubleshooting various user issues

• 8 to 10 years of experience as a Senior Data Engineer

• Sphere head projects and teams

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases

• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

• Programming/debugging skills in Java/Scala/Python

• Experience in scripting and JavaScript frameworks

• Database Knowledge (Snowflake, MySQL, Oracle, Redis, Memcache, etc)

• Hands-on with Design, Coding, Debugging and Testing

• Very good in Algorithms, Data structures, and Time Complexities

• Very good knowledge of OOPS and Design patterns.

• Willingness to learn and experiment with new technology.

• Experience with cloud infrastructure is preferable.

Connect With Us

Billow People Services Private Limited,
# 57, Anto Bhavan,
4th Cross, Jayaram Shetty Layout,
Geetha Clinic Road, Devasandra,
K R Puram, Bengaluru-560036.

Email: inquiry@billowpeople.com