Data Engineer

Overview

Role- Data Engineer

Experience -2+yrs

Location- Remote

• Work with business stakeholders to understand the business requirements and the data available to solve the corresponding problems
• Work with very large data sets and build large scale data processing platforms, implement data governance and operational controls, solve complex performance challenges and build robust ETL pipelines
• Gather and process raw data at scale from different business domains, build real time data ingestion pipeline into a data lake in Hadoop/Google Cloud/other cloud solutions
• Influence teams to improve data infrastructure in a product work-oriented environment.
• Build automated deployments of databases and machine learning models
• Implement controls, processes and best practices in data engineering
• Build tools and automation to facilitate and collect metrics for data and operational governance, data lineage, data quality and monitoring.
• Be proactive and take ownership of the projects and tasks assigned
• Provide and support the implementation of business solutions
• Collaborate with other data scientists and data engineers in our team
• Lead small and participate in large project teams
• Coach junior members and share knowledge with the broader team
• Continue to widen and deepen data engineering and data analytics skillsets

Additional Preferred Qualifications

• 2+ years of relevant industry experience
• Experience in engineering scalable data platforms using technologies including Spark (batch/streaming), Hadoop, Hive, HBase, Kafka, Airflow.
• Experience in building data output streams and API’s using Java and Kafka
• Development experience with Python, Java
• Solid hands-on experience in building data pipelines, deploying and managing Big Data infrastructure, working with large structured and unstructured datasets
• Experience in Relational databases, Data Warehousing, SQL, ETL and/or NOSQL databases.
• Strong verbal and written communication skills

If interested, share your resume on aditya.dhumal@leanitcorp.com

Job Type: Full-time

Work Location: Remote