Scraper - Python developer

Overview

We are seeking a highly experienced Python Developer with a strong background in web scraping, specifically for e-commerce platforms. The ideal candidate will have deep expertise in extracting structured and unstructured data from various sources, optimizing scraping performance, and maintaining data integrity.

Key Responsibilities:

• Design, build, and maintain automated web scraping scripts for e-commerce platforms (Shopify, Amazon, Flipkart, etc.)
• Handle dynamic content using tools like Selenium, Playwright, or Puppeteer
• Develop robust scraping infrastructure with error handling, proxies, and captchas bypassing
• Normalize, clean, and store scraped data in databases or cloud storage
• Monitor scraping processes for reliability and implement logging & alerting
• Ensure compliance with robots.txt, rate limits, and website terms
• Collaborate with data and product teams to identify scraping needs

Requirements:

• 4–5 years of professional experience with Python-based web scraping
• Strong knowledge of BeautifulSoup, Scrapy, Selenium, Requests, and LXML
• Experience scraping large-scale or real-time e-commerce product catalogs
• Familiarity with headless browsers and techniques for bypassing bot protections
• Strong understanding of HTML, CSS, JavaScript, and JSON/XML parsing
• Experience with SQL/NoSQL databases and data pipelines
• Knowledge of version control (Git) and task automation tools (e.g., Airflow, Celery) is a plus

Job Type: Full-time

Pay: ₹40,000.00 - ₹70,000.00 per month

Schedule:

• Day shift

Work Location: Remote