Senior Data Engineer

Overview

large-scaleRole: Data Engineer

Location: Multiple locations

Mode: Hybrid

Type: Permanent

Job Description:

What You'll Do

• Provide the organization’s data consumers high quality data sets by data curation, consolidation, and manipulation from a wide variety of large-scale (terabyte and growing) sources.
• Build first-class data products and ETL processes that interact with terabytes of data on leading platforms such as Snowflake and BigQuery.
• Partner with our Analytics, Product, CRM, and Marketing teams.
• Be responsible for managing the SLAs and dependencies of the data pipelines.
• Write technical documentation for data solutions and present at design reviews.
• Solve data pipeline failure events and implement anomaly detection.
• Work with various teams from Data Science, Product owners, to Marketing and software engineers on data solutions and solving technical challenges.
• Mentor junior members of the team

What We Seek

Education and Work Experience

• Bachelor’s degree in Computer Science or related field
• 8+ Years of experience in commercial data engineering or software development.

Tech Experience

• Experience with Big Data technologies such as Snowflake, Databricks, PySpark
• Expert-level skills in writing and optimizing complex SQL; advanced data exploration skills with a proven record of querying and analyzing large datasets.
• Solid experience developing complex ETL processes from concept to implementation to deployment and operations, including SLA definition, performance measurements and monitoring.
• Hands-on knowledge of the modern AWS Data Ecosystem, including AWS S3
• Experience with relational databases such as Postgres, and with programming languages such as Python and/or Java
• Knowledge of cloud data warehouse concepts.
• Experience in building and operating data pipelines and products in compliance with the data mesh philosophy would be beneficial. Demonstrated efficiency in treating data, including data lineage, data quality, data observability, and data discoverability.

Communication/people skills

• Excellent verbal and written communication skills. Ability to convey key insights from complex analyses in summarized business terms to non-technical stakeholders and also ability to communicate with other technical teams effectively.
• Strong interpersonal skills and the ability to work in a fast-paced and dynamic environment.
• Ability to make progress on projects independently and enthusiasm for solving difficult problems.

Job Type: Permanent

Pay: ₹3,000,000.00 - ₹4,500,000.00 per year

Benefits:

• Work from home

Schedule:

• Day shift
• Monday to Friday

Experience:

• Data Engineering: 7 years (Required)
• Snowflake: 4 years (Required)
• DataBricks: 4 years (Required)
• Python: 3 years (Required)
• SQL: 3 years (Required)
• AWS: 4 years (Required)

Work Location: Remote