Data Engineer

BhaiFi Networks Private Limited is a leading provider of AI-powered cybersecurity solutions, designed to safeguard businesses - especially small and medium-sized enterprises (SMEs) - against evolving digital threats. Founded in 2017, our mission is to democratize cybersecurity by making enterprise-grade protection accessible and easy to use for businesses of all sizes, even those with lean or non-technical teams.

We offer two flagship products:

• BhaiFi – AI-Powered Guest WiFi: https://bhaifi.ai
• FirewallX – An AI-First Network Security and Management Platform: https://firewallx.ai
  
  

With features like advanced firewall protection, intrusion detection, secure VPN, real-time threat intelligence, and more, we help our customers secure their networks with ease. We’re a lean, high-impact team redefining how modern cybersecurity is built.

Requirements

Job Description: The Data Engineer will be responsible for designing, implementing, and maintaining the data infrastructure that powers our network security machine learning project. This role involves creating efficient data pipelines, ensuring data quality, and collaborating closely with the Data Scientist Lead and ML/LLM Developer and to support model deployment and operation.

Key Responsibilities:

• Design and implement scalable data pipelines for ingesting and processing network security data
• Perform data preprocessing and feature engineering to prepare data for machine learning models
• Set up and manage data storage solutions, including Elasticsearch
• Handle model deployment and implement DevOps practices
• Develop comprehensive testing strategies for data pipelines and deployed models
• Ensure data quality, integrity, and availability for machine learning models
• Collaborate with the team to optimize data flow and model performance
  
  

Required Skills:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or related field
• 3-5 years of experience in data engineering
• Strong programming skills in Python
• Expertise in big data technologies (Hadoop, Spark, Hive)
• Proficiency in SQL and experience with various database systems (PostgreSQL, MySQL, MongoDB)
• Experience with data pipeline tools (Apache Airflow)
• Familiarity with Elasticsearch for efficient data storage and retrieval
• Experience with stream processing frameworks (Apache Kafka, Apache Flink)
• Proficiency in version control systems (Git)
• Understanding of data modelling and ETL processes
• Experience with real-time data processing and analytics
• Knowledge of machine learning deployment processes
• Familiarity with network protocols and security concepts
• Experience with containerization and orchestration (Docker, Kubernetes)
• Experience with CI/CD tools (Jenkins, GitLab CI)