Chennai, Tamil Nadu, India
Information Technology
Full-Time
Netscribes
Overview
Responsibilities
The core requirements for the job include the following:
- Design, build, and maintain web scraping applications to ingest competitor data from various online retail platforms.
- Develop RESTful APIs in Python (FastAPI / Flask / Django) to serve extracted data for downstream consumption.
- Containerize and deploy API services using Docker and orchestrate deployments via Azure DevOps / GitHub Actions.
- Utilize Azure services such as Azure Functions, Azure App Services, Azure Data Lake, Azure Key Vault, and Azure Monitor for end-to-end deployment and monitoring.
- Implement logging, exception handling, and retry mechanisms to build robust scraping and ingestion pipelines.
- Integrate open-source libraries (e. g., BeautifulSoup, Scrapy, Playwright, Puppeteer, Selenium) for scalable web data extraction.
- Collaborate with Data Scientists and Analysts to make the scraped data queryable and usable for analytics.
- Build dashboards or simple frontends (if needed) to monitor scraping coverage and API health.
- Work with Git-based version control, agile tools (JIRA/Confluence), and participate in code reviews and CI/CD cycles.
The core requirements for the job include the following:
- Strong proficiency in Python (3 x) - with production experience
- REST API development using FastAPI, Flask, or Django REST Framework
- Experience with Web Scraping tools - BeautifulSoup, Scrapy, Playwright/Selenium
- JSON handling, data transformation, and exception management
- Azure Cloud services experience: Azure App Services, Azure Functions, Azure Key Vault, Azure Blob / Data Lake, Azure Monitor / Application Insights. CI/CD using Azure DevOps or GitHub Actions.
- Docker-based development and deployment.
- Good understanding of data formats (JSON, CSV, Parquet).
- Experience working with relational databases (SQL) and awareness of NoSQL (MongoDB/Cosmos DB).
- Basic knowledge of data pipelines, data validation, and ETL design patterns.
- Working knowledge of open-source libraries and tools for scraping, APIs, or lightweight frontends.
- Git and collaborative development workflows.
- Basic front-end skills: HTML/CSS/JavaScript (for monitoring dashboards or UI components).
- Knowledge of Azure Data Factory, Event Grid, or Azure Logic Apps.
- Familiarity with retail/fashion data models like product attributes, pricing, and catalog taxonomy.
- Experience with ElasticSearch or BigQuery for storing and querying semi-structured data.
- Exposure to DataOps/MLOps pipelines.
Similar Jobs
View All
14 Hours ago
Technical Writer| 3-7Years|Pune
Information Technology
- 1300000 - 1600000 INR - Annual
- 3 - 7 Yrs
- Pune
THE POSITION
We’re looking for a motivated, driven and collaborative Software Technical Writer that will be an integral member of a small software technical writing team. As a Technical Writer with my client, you will be working with multiple team...
20 Hours ago
Software Developer - SDE1 Backend
Information Technology
- 2 - 4 Yrs
- Mumbai
Key Responsibilities:
● Design, develop, and maintain software applications using Golang, Node.js and PHP.
● Create and optimize database schemas and queries using MySQL and MongoDB.
● Implement caching solutions with Redis.
● Integra...
21 Hours ago
OIC Lead
Information Technology
- 7 - 14 Yrs
- Chennai, Bengaluru
Are you an expert in Oracle Integration Cloud (OIC) with a proven track record of delivering seamless integration solutions. We’re looking for a seasoned OIC Technical consultant with 6 to 10 years of experience and at least 5+ years of hands on expe...
2 Days ago
PHP Developer - Laravel Framework
Information Technology
- Chennai, Tamil Nadu, India
Company DescriptionQuokka Labs is an AI-native engineering services company, globally recognized for excellence by platforms like Clutch and GoodFirms.We specialize in building scalable, future-ready software solutions tailored to today's fast-evolv...
2 Days ago
.Net Developer - C# Programming
Information Technology
- Chennai, Tamil Nadu, India
Job Title : Azure .NET DeveloperCompany : Mouri?TechRole : Azure : .NET DeveloperLocation : Hyderabad, Chennai, Bangalore, Vizag (Hybrid)Employment Type : Full?TimeExperience : 69 yearsRole OverviewWere seeking an experienced Azure .NET Develope...
2 Days ago
Senior DevOps Engineer, Trilogy (Remote) - $100,000/year USD
Information Technology
- 50 - 50 INR - Hourly
- Chennai, Tamil Nadu, India
Are you ready to transform chaos into order and take control of multi-stack infrastructures?What You Will Be Doing Strategically plan and execute complex infrastructure migrations from legacy systems to a streamlined AWS cloud environment. Innovate ...
2 Days ago
CollegeDekho - Software Engineer - Artificial Intelligence Applications
Information Technology
- Chennai, Tamil Nadu, India
About The RoleWere looking for a Software Engineer to join our AI team, where we build, deploy, and scale end-to-end AI applications. This role is ideal for someone who has solid experience in Python-based web development and has worked hands-on wit...
2 Days ago
Senior DevOps Engineer, Trilogy (Remote) - $100,000/year USD
Information Technology
- 50 - 50 INR - Hourly
- Chennai, Tamil Nadu, India
Are you ready to transform chaos into order and take control of multi-stack infrastructures?What You Will Be Doing Strategically plan and execute complex infrastructure migrations from legacy systems to a streamlined AWS cloud environment. Innovate ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in