Bangalore, Karnataka, India
Human Rights & Ethics in Tech
Full-Time
Petonic Infotech
Overview
We're seeking a highly motivated Senior Data Engineer with 7-8+ years of experience to design, deploy, and maintain robust data pipelines and cloud-native data solutions. In this critical role, you'll support cutting-edge AI/ML initiatives, optimize complex data systems, and ensure seamless data flow for advanced analytics.
If you're a hands-on engineer with a passion for building scalable data infrastructure in the cloud and optimizing database performance, we encourage you to apply!
Key Responsibilities
If you're a hands-on engineer with a passion for building scalable data infrastructure in the cloud and optimizing database performance, we encourage you to apply!
Key Responsibilities
- Data Pipeline Development : Design, develop, and maintain highly scalable and reliable data pipelines for both batch and real-time processing, ensuring data quality and integrity.
- Cloud Data Solution Deployment : Lead the deployment and management of cloud-based data solutions and services on major cloud platforms such as AWS, Azure, or Google Cloud Platform.
- CI/CD & Automation : Implement and optimize CI/CD pipelines for automated deployment of data infrastructure, applications, and configurations using infrastructure-as-code principles.
- Database Management : Administer, manage, and optimize performance for both relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB), ensuring robust backup, recovery, and replication strategies.
- Infrastructure Oversight : Oversee server provisioning, deployment, configuration, and monitoring of the entire data infrastructure in cloud and hybrid environments.
- AI/ML Collaboration : Collaborate closely with AI/ML teams to streamline data workflows, optimize data ingestion for model training, and ensure efficient data delivery for model inference.
- Security & Compliance : Implement and maintain robust security measures, ensure data integrity, and adhere to compliance standards across all data systems and pipelines.
- Performance Monitoring & Troubleshooting : Proactively monitor system performance, identify bottlenecks, and troubleshoot complex data infrastructure and database-related issues to ensure high availability and reliability.
- Experience : 7-8+ years of progressive experience in data engineering and infrastructure deployment roles.
- Database Expertise : Strong expertise in database management and optimization for PostgreSQL, MySQL, and MongoDB. This includes performance tuning, indexing, backup/restore, and high availability configurations.
- Cloud Platforms : Hands-on experience with at least two major cloud platforms (AWS, Google Cloud Platform, or Azure) and proficiency in deploying and managing data services within these environments.
- Infrastructure as Code : Proven experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Azure Resource Manager).
- CI/CD Proficiency : Proficiency with CI/CD tools and practices using platforms like Jenkins, GitLab CI/CD, or GitHub Actions.
- Scripting Skills : Strong scripting skills in Python for automation, data processing, and infrastructure management.
- Server/Database Administration : Solid understanding of server and database administration principles in cloud and hybrid environments.
- AI/ML & MLOps : Familiarity with AI/ML data workflows, feature engineering, and MLOps concepts is a significant plus.
- Soft Skills : Excellent communication, collaboration, and problem-solving skills, with the ability to work effectively in cross-functional teams.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in