Devops Engineer with MlOps & LLM ( Remote )

Job Title: Devops Engineer with MlOps & LLM ( Remote )

Job Type: Contract

Contract Duration: 2 Months (as needed basis)

Experience: 6+ Years

Location: Remote

JOB DESCRIPTION & RESPONSIBILITIES

• We Are Seeking a skilled and proactive DevOps Engineer to support with expertise to contribute to the design and development of a scalable, user-friendly front-end application for our AI-driven platform enabling search, recommendations and GIS based interactions.. The ideal candidate will have extensive experience in managing both cloud and on-premises infrastructure, implementing CI/CD pipelines, and optimizing system performance to ensure seamless integration and deployment of features. They should possess deep expertise in observability tooling, container orchestration, and MLOps for large language models (LLMs). This role involves managing the full DevOps lifecycle while closely collaborating with development, QA, and operations teams to drive reliability, scalability, and continuous delivery across secure, distributed environments.

• Manage infrastructure across AWS/Azure for development and lower environments.

• Setup, configure, and manage Kubernetes (K8s) clusters in hybrid environments.

• Integrate OpenTelemetry and Application Performance Monitoring (APM) tools for observability and performance tracking.

• Collaborate with ML teams to implement and scale MLOps pipelines for training, tuning, and deploying LLMs

• Build and maintain continuous integration/continuous deployment (CI/CD) pipelines for efficient software delivery.

• Automate build, test, and deployment processes to streamline development workflows.

• Manage and configure development, staging, and production environments.

• Ensure consistency and stability across all environments through automation and configuration management tools.

• Implement security best practices, including access controls, vulnerability scanning, and compliance monitoring.

• Regularly update and patch infrastructure components to mitigate security risks.

• Set up and maintain monitoring tools to track application performance and system health.

• Configure logging and alerting mechanisms to proactively identify and address issues.

• Work closely with development, QA, and operations teams to troubleshoot issues and ensure smooth deployments.

• Provide guidance and support for infrastructure-related tasks and challenges.

• Identify and implement improvements to DevOps processes and workflows.

• Stay updated on industry trends and tools to enhance DevOps practices.

PRIMARY SKILLS

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• 3–5 years of experience as a DevOps Engineer or in a similar role.

• Proficiency in designing and managing CI/CD pipelines using Azure DevOps, Jenkins, or similar tools.

• Experience with tools like Kubeflow, MLflow, or SageMaker for MLOps.

SECONDARY SKILLS(IF ANY)

• Proficiency in containerization tools such as Docker and orchestration platforms like Kubernetes.

• Strong knowledge of version control systems like Git and branching strategies.

• Understanding of network configurations, VPNs, firewalls, and load balancers.

• Familiarity with Agile methodologies and DevOps principles.

CERTIFICATIONS REQUIRED(IF ANY)

Certification in relevant skills will be considered an added advantage