Vadodara, Gujarat, India
Real Estate & Construction
Full-Time
UnifyCX
Overview
Job Summary
As a DevOps Engineer specializing in data, you will be responsible for implementing and managing our cloud-based data infrastructure using AWS and Snowflake. You will collaborate with data engineers, data scientists, and other stakeholders to design, deploy, and maintain a robust data ecosystem that supports our analytics and business intelligence initiatives. Your expertise in modern data tech stacks, MLOps methodologies, automation, and information security will be crucial in enhancing our data pipelines and ensuring data integrity and availability.
Key Responsibilities
As a DevOps Engineer specializing in data, you will be responsible for implementing and managing our cloud-based data infrastructure using AWS and Snowflake. You will collaborate with data engineers, data scientists, and other stakeholders to design, deploy, and maintain a robust data ecosystem that supports our analytics and business intelligence initiatives. Your expertise in modern data tech stacks, MLOps methodologies, automation, and information security will be crucial in enhancing our data pipelines and ensuring data integrity and availability.
Key Responsibilities
- Infrastructure Management: Design, deploy, and manage AWS cloud infrastructure for data storage, processing, and analytics, ensuring high availability and scalability while adhering to security best practices.
- Data Pipeline Deployment: Collaborate with data engineering teams to deploy and maintain efficient data pipelines using tools like Apache Airflow, dbt, or similar technologies.
- Snowflake Administration: Implement and manage Snowflake data warehouse solutions, optimizing performance and ensuring data security and governance.
- MLOps Implementation: Collaborate with data scientists to implement MLOps practices, facilitating the deployment, monitoring, and governance of machine learning models in production environments.
- Information Security: Integrate security controls into all aspects of the data infrastructure, including encryption, access control, and compliance with data protection regulations (e.g., GDPR, HIPAA).
- CI/CD Implementation: Develop and maintain continuous integration and continuous deployment (CI/CD) pipelines for data-related applications and services, including model training and deployment workflows.
- Support and Troubleshooting: Deploy updates and fixes, provide Level 2 technical support, and perform root cause analysis of production errors to resolve technical issues effectively.
- Tool Development: Build tools to reduce the occurrence of errors and improve the customer experience, and develop software to integrate with internal back-end systems.
- Automation and Visualization: Develop scripts to automate data visualization and streamline reporting processes.
- System Maintenance: Design procedures for system troubleshooting and maintenance, ensuring smooth operation of the data infrastructure.
- Monitoring and Performance Tuning: Implement monitoring solutions to track data workflows and system performance, proactively identifying and resolving issues.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and support analytics initiatives.
- Documentation: Create and maintain documentation for data architecture, processes, workflows, and security protocols to ensure knowledge sharing and compliance.
- Bachelor’s degree in Computer Science, Engineering, or 3+ years of experience as a DevOps engineer or in a similar engineering role.
- Strong expertise in AWS services (e.g., EC2, S3, Lambda, RDS) and cloud infrastructure best practices.
- Proficient in Snowflake, including data modeling, performance tuning, and query optimization.
- Experience with modern data technologies and tools (e.g., Apache Airflow, dbt, ETL processes).
- Familiarity with MLOps frameworks and methodologies, such as MLflow, Kubeflow, or SageMaker.
- Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
- Proficiency in scripting languages, including Python, Ruby, PHP, and Perl, and automation frameworks.
- Proficiency with Git and GitHub workflows.
- Working knowledge of databases and SQL.
- Strong understanding of CI/CD tools and practices (e.g., Jenkins, GitLab CI).
- Knowledge of information security principles, including data encryption, access control, and compliance frameworks.
- Excellent problem-solving attitude and collaborative team spirit.
- Strong communication skills, both verbal and written.
- Experience with data governance and compliance frameworks.
- Familiarity with data visualization tools (e.g., Tableau, Looker).
- Knowledge of machine learning frameworks and concepts is a plus.
- Relevant security certifications (e.g., CISSP, CISM, AWS Certified Security) are a plus.
- Competitive salary and benefits package.
- Opportunities for professional development and continuous learning.
- A collaborative and innovative work environment.
- Flexible work arrangements.
Similar Jobs
View All
20 Hours ago
Technical Lead - Backend (Node.js)
Information Technology
- 5 - 10 Yrs
- Bangalore
ROLE : Technical Lead
LOCATION : Bengaluru
What you'll be doing :
We are much more than our job descriptions, but here is where you will begin :
- Collaborate with stakeholders, including product owners, project managers, and scrum mast...
22 Hours ago
Angular Developer
Information Technology
- 7 - 12 Yrs
- Anywhere in India/Multiple Locations
Job Title: Angular Developer
Experience: 7+ Years
Locations: Bangalore, Pune, Chennai, Noida, Gurgaon, Delhi, Kochi, Pollachi, Manesar, Ahmedabad
Key Responsibilities:
Develop and maintain robust web applications using Angular 14+, Jav...
1 Day ago
Azure Data Engineer - ETL/Data Factory
Real Estate & Construction
- Vadodara, Gujarat, India
Location : GurugramWorkmode : WFONotice Period : Immediate up to 45 daysWe are seeking a skilled Data Engineer to develop and support cloud-based data platforms that enable advanced analytics, data science, and reporting. You will work on integra...
1 Day ago
Software Developer 2
Real Estate & Construction
- Vadodara, Gujarat, India
This role will be working in our Indore office five (5) days a week.Vena Solutions is seeking a Software Developer to help us expand our sophisticated SaaS cloud technology. This role is a match for you if you are an innovative software engineer wit...
1 Day ago
Senior Data Engineer (PLSQL Developer)
Pharmaceuticals
- Bangalore, Karnataka, India
Job Title: Senior Data Engineer (PLSQL Developer)Location: Bangalore (Hybrid)Position Type: Full-TimeAbout The CompanyRelanto is a global advisory, consulting, and technology services partner, empowering customers to accelerate innovation by harness...
1 Day ago
QA Engineer in Gautam Buddha Nagar, Noida, Delhi, Faridabad, Ghaziabad, Greater Noida
Pharmaceuticals
- Bangalore, Karnataka, India
Key Responsibilities Analyzing user stories/use cases/requirements for validity and feasibility. Analyze test results to predict user behaviour, identify bugs, and suggest solutions to minimize problems. Prepare documentation on user behaviours a...
1 Day ago
DevOps Engineer - Docker/Kubernetes
Pharmaceuticals
- Bangalore, Karnataka, India
About The RoleWe're looking for a highly experienced DevOps Engineer with a strong foundation in Linux, Kubernetes, AWS, and scripting. You will play a crucial role in automating, scaling, and securing infrastructure for high-traffic systems, partic...
1 Day ago
Application Developer (Low-Code)
Pharmaceuticals
- Bangalore, Karnataka, India
Job Title- Appian EngineerPosition type- Full TimeWork Location-Bangalore/DelhiNCRWorking style- HybridPeople Manager role: NoRequired Education And Certifications Critical For The Role-Any Graduate or Post-Graduate (full time)Required Years Of Expe...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in