Data Engineer II/ Back end engineer

Overview

You will be part of One Data function and help develop various integration solutions for their data communication needs.

System Requirements

You will be responsible for creating innovative interoperability platforms, tools and solutions to enable seamless and secure data integration. Your solutions will be used to connect legacy, newly developed, and vendor applications across the datacenter and cloud environments, and you will be responsible for the full lifecycle of the solutions:

• Developing specifications
• Designing infrastructure and interfaces
• Developing code
• Implementing the platform
• Helping our customers use it
• Continuously improving the platform
  
  

Design, develop, test, operate and maintain products and enterprise-level API Service Architecture

Experience with Domain-based Microservice Architecture

Identify, design and implement internal process improvements, automate manual processes, optimize service integration, and propose re-designing of infrastructure as appropriate to achieve scalability and cost reduction

Design and develop designs, architectures, standards, and methods for large-scale distributed systems with focus on security, resiliency, scale, and performance.

Find opportunities to embrace innovative technologies

Focuses on cross-platform integration to use and optimize platform capabilitie

Serve as a core team member, responsible for providing solutions for large high priority cross platform initiatives.

Drive root cause analysis and problem management process to prevent problem recurrence.

Analyze existing operations and schedule training sessions and meetings to discuss improvements

Keep up to date with industry trends and developments

Build the infrastructure required for integration and deployment of API services both on-prem and cloud.

End-End ownership of critical service – availability, latency, performance, efficiency, management, monitoring, capacity planning, performance analysis and system tuning for entire services.

Skills

Proficient in building large-scale systems end to end using Java/Python/Golang or other high-performance languages, developer tools, CI/CD, DevOps, monitoring tools and engineering cloud migration solutions

Hands on experience working with API Architecture and Solution Design - REST/GraphQL/gRPC and API Development using Spring boot and Spring framework, RDBMS & No-SQL (e.g., PostgreSQL, Elastic Search)

10+ years of experience in technologies including Docker, Kubernetes, DevOPs, Observability, Site Reliability Engineering (Eg: Tools like ArgoCD, jFrog, Git, Git Workflows)

Work with API developers across the teams to build new API features at large scale

Expertise in AWS Cloud - AWS CLI, Lambda, API Gateway, IAM, NLB/ELB, Elastic Search, Document DB, EKS, Cloud Networking and Security

Experience with IAAC - Terraform/CloudFormation.

Experience with Observability/Monitoring technologies: Splunk, Cloud watch, Dynatrace

Experience with AI Agents build and enhance API Engineering experience , exposure to recent tech AI trends.

Education

Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus