Sr. DevOps Engineer

Overview

Cloud Platform: Amazon Web Services (AWS) – The backbone providing robust, scalable, and secure infrastructure.

• Ingestion Layer (Data Ingestion Frameworks):

o Apache Nifi: For efficient, real-time data routing, transformation, and mediation from diverse sources.

o Data Virtuality: Facilitates complex ETL and data virtualization, creating a unified view of disparate data.

• Data Frameworks (Data Processing & Microservices):

o Rules Engine & Eductor (In-house Tools - Scala, Python): Our proprietary microservices for specialized data handling and business logic automation.

o Kafka: Our high-throughput, fault-tolerant backbone for real-time data streaming and event processing.

• Analytics Layer (Analytics Services & Compute):

o Altair: For powerful data visualization and interactive analytics.

o Apache Zeppelin: Our interactive notebook for collaborative data exploration and analysis.

o Apache Spark: Our unified analytics engine for large-scale data processing and machine learning workloads.

• Data Presentation Layer (Client-facing & APIs):

o Client Services (React, TypeScript): For dynamic, responsive, and type-safe user interfaces.

o Client APIs (Node.js, Nest.js): For high-performance, scalable backend services.

• Access Layer:

o API Gateway (Amazon API Gateway): Manages all external API access, ensuring security, throttling, and routing.

o AWS VPN (Clients, Site-to-Site, OpenVPN): Secure network connectivity.

o Endpoints & Service Access (S3, Lambda): Controlled access to core AWS services.

o DaaS (Data-as-a-Service - Dremio, Data Virtuality, PowerBI): Empowering self-service data access and insights.

• Security Layer:

o Firewall (AWS WAF): Protects web applications from common exploits.

o IdM, IAM (Keycloak, AWS Cognito): Robust identity and access management.

o Security Groups & Policy (AWS): Network-level security and granular access control.

o ACLs (Access Control Lists - AWS): Fine-grained control over network traffic.

o VPCs (Virtual Private Clouds - AWS): Isolated and secure network environments.

• Data Layer (Databases & Storage):

o OpenSearch Services: For powerful search, analytics, and operational data visualization.

o Data Warehouse – AWS Redshift: Our primary analytical data store.

o Databases (PostgreSQL, MySQL, OpenSearch): Robust relational and search-optimized databases.

o Storage (S3 Object Storage, EBS, EFS): Highly scalable, durable, and cost-effective storage solutions.

• Compute & Orchestration:

o EKS (Amazon Elastic Kubernetes Services): Manages our containerized applications, providing high availability and scalability for microservices.

Job Types: Full-time, Contractual / Temporary
Contract length: 6 months

Pay: ₹50,000.00 - ₹60,000.00 per month

Schedule:

• Monday to Friday
• Weekend availability

Work Location: Remote