Data Engineer - Specialist

Reporting to the A/NZ DSE Chapter Manager India PEC within Decision Sciences & Engineering, this role will own and be responsible for the data & analytic engineering chapter in India PEC.

The Data Engineer is an essential part of the business that enables the team to support the ongoing acquisition and internal purposing of data, through to the fulfilment of products, insights and systems. As a Data Engineer, you will be responsible for working with our internal customers to ensure that data and systems are being designed and built to move and manipulate data in a scalable, reusable and efficient manner to suit the environment, project, security and requirements.

What You’ll Do

• Design, architect, and implement scalable and secure data pipelines on GCP, utilizing services like Dataflow, Pub/Sub, and Cloud Storage.
• Develop and maintain data models, ensuring data quality, consistency, and accessibility for various internal stakeholders.
• Automate data processes and workflows using scripting languages like Python, leveraging technologies like Spark and Airflow.
• Monitor and troubleshoot data pipelines, identifying and resolving performance issues
• proactively.
• Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
• Implement data governance best practices, including data security, access control, and lineage tracking.
  
  

You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards and end user requirements. You will execute tests using established plans and scripts; documents problems in an issues log and retest to ensure problems are resolved. You will create test files to thoroughly test program logic and verify system flow. You will identify, recommend and implement changes to enhance effectiveness of QA strategies.

What You Will Do

• Independently develop scalable and reliable automated tests and frameworks for testing software solutions.
• Specify and automate test scenarios and test data for a highly complex business by analyzing integration points, data flows, personas, authorization schemes and environments
• Develop regression suites, develop automation scenarios, and move automation to an agile continuous testing model.
• Pro-actively and collaboratively taking part in all testing related activities while establishing partnerships with key stakeholders in Product, Development/Engineering, and Technology Operations.
  
  

What Experience You Need

• Bachelor's degree in a STEM major or equivalent experience
• 5-7 years of software testing experience
• Able to create and review test automation according to specifications
• Ability to write, debug, and troubleshoot code in Java, Springboot, TypeScript/JavaScript, HTML, CSS
• Creation and use of big data processing solutions using Dataflow/Apache Beam, Bigtable, BigQuery, PubSub, GCS, Composer/Airflow, and others with respect to software validation
• Created test strategies and plans
• Led complex testing efforts or projects
• Participated in Sprint Planning as the Test Lead
• Collaborated with Product Owners, SREs, Technical Architects to define testing strategies and plans.
• Design and development of micro services using Java, Springboot, GCP SDKs, GKE/Kubeneties
• Deploy and release software using Jenkins CI/CD pipelines, understand infrastructure-as-code concepts, Helm Charts, and Terraform constructs
• Cloud Certification Strongly Preferred
  
  

What Could Set You Apart

An ability to demonstrate successful performance of our Success Profile skills, including:

• Attention to Detail - Define test case candidates for automation that are outside of product specifications. i.e. Negative Testing; Create thorough and accurate documentation of all work including status updates to summarize project highlights; validating that processes operate properly and conform to standards
• Automation - Automate defined test cases and test suites per project
• Collaboration - Collaborate with Product Owners and development team to plan and and assist with user acceptance testing; Collaborate with product owners, development leads and architects on functional and non-functional test strategies and plans
• Execution - Develop scalable and reliable automated tests; Develop performance testing scripts to assure products are adhering to the documented SLO/SLI/SLAs; Specify the need for Test Data types for automated testing; Create automated tests and tests data for projects; Develop automated regression suites; Integrate automated regression tests into the CI/CD pipeline; Work with teams on E2E testing strategies and plans against multiple product integration points
• Quality Control - Perform defect analysis, in-depth technical root cause analysis, identifying trends and recommendations to resolve complex functional issues and process improvements; Analyzes results of functional and non-functional tests and make recommendation for improvements; Performance / Resilience: Understanding application and network architecture as inputs to create performance and resilience test strategies and plans for each product and platform. Conducting the performance and resilience testing to ensure the products meet SLAs / SLOs
• Quality Focus - Review test cases for complete functional coverage; Review quality section of Production Readiness Review for completeness; Recommend changes to existing testing methodologies for effectiveness and efficiency of product validation; Ensure communications are thorough and accurate for all work documentation including status and project updates
• Risk Mitigation - Work with Product Owners, QE and development team leads to track and determine prioritization of defects fixes