Python Web Scraping Developer

Overview

Responsibilities:

• Develop web scrapers to monitor dark web marketplaces, forums, and leak sites (Tor, I2P, ZeroNet).
• Extract and parse data from Telegram channels, groups, and bots using Telegram API and unofficial libraries like Telethon.
• Scrape deep web & restricted-access websites while handling CAPTCHAs, rate limits, and anti-bot mechanisms.
• Implement proxy rotation, Tor network scraping, headless browsing, and other evasion techniques.
• Analyze, structure, and store extracted data in Elasticsearch, PostgreSQL, MongoDB, or cloud storage.
• Automate real-time monitoring of data leaks, cyber threats, credentials dumps, and brand impersonation.
• Work with NLP and ML models to classify and extract relevant insights from unstructured data.
• Ensure compliance with ethical, legal, and security guidelines in data collection.
• Develop APIs to serve the scraped data to internal security tools.

Required Skills & Qualifications:

• Expert in Python with experience in web scraping frameworks (Scrapy, BeautifulSoup, Selenium, Playwright).
• Hands-on experience with Tor (Stem), I2P, Telegram API, Telethon, Socks5 proxies.
• Strong understanding of network protocols, HTTP headers, encryption, and anonymity.
• Experience in handling CAPTCHAs, browser fingerprinting, user-agent spoofing.
• Proficiency in working with Telegram scraping (Telethon, Pyrogram, or MTProto API).
• Knowledge of threat intelligence, OSINT, cyber threat monitoring.
• Experience in database management (PostgreSQL, MongoDB, Redis, Elasticsearch).
• Ability to handle large-scale data processing and automation.

Job Type: Full-time

Pay: ₹12,841.99 - ₹40,000.00 per month

Benefits:

• Health insurance

Schedule:

• Day shift
• Morning shift

Supplemental Pay:

• Performance bonus
• Yearly bonus

Work Location: In person

Application Deadline: 15/03/2025
Expected Start Date: 15/03/2025