Software Engineer - S360

Job Description

We are seeking a Senior GCP Software Engineer with Data Engineering knowledge to be part of the Data products Development team. This individual contributor role is pivotal in delivering Data products at speed for our Analytical business customers. The role involves handling real time repair order data, designing and modeling solutions, and developing solutions for real world business problems. Expectations are that the candidate will be able to interface with business customers, management, and is knowledgeable about the GCP platform. Looking for a candidate that is self-motivated to expand their role, proactively address challenges that arise, share knowledge with the team, and is not afraid to think outside the box to identify solutions.

Your skills shall be utilized to analyse and transform large datasets, support Analytics in GCP, and ensure development process and standards are met to sustain the growing infrastructure and business needs.

Responsibilities

• Work on a small agile team to deliver curated data products for the Product Organization.
• Work effectively with fellow data engineers, product owners, data champions and other technical experts.
• Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
• Develop exceptional analytical data products using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principles.
• Be the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies.
• Architect and implement sophisticated ETL pipelines, ensuring efficient data integration into Big Query from diverse batch and streaming sources.
• Spearhead the development and maintenance of data ingestion and analytics pipelines using cutting-edge tools and technologies, including Python, SQL, and DBT/Data form.
• Ensure the highest standards of data quality and integrity across all data processes.
• Data workflow management using Astronomer and Terraform for cloud infrastructure, promoting best practices in Infrastructure as Code
• Rich experience in Application Support in GCP. Experienced in data mapping, impact analysis, root cause analysis, and document data lineage to support robust data governance.
• Develop comprehensive documentation for data engineering processes, promoting knowledge sharing and system maintainability.
• Utilize GCP monitoring tools to proactively address performance issues and ensure system resilience, while providing expert production support.
• Provide strategic guidance and mentorship to team members on data transformation initiatives, championing data utility within the enterprise.
• Ability to model data products to implement standardization and optimization of data products from inception
  
  
  

Qualifications

• Experience working in API services (Kafka topics) and GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc etc.
• Experience working with Airflow for scheduling and orchestration of data pipelines.
• Experience working with Terraform to provision Infrastructure as Code.
• 2 + years professional development experience in Java or Python.
• Bachelor’s degree in computer science or related scientific field.
• Experience in analysing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products.
• Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption.
• Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management.