Bangalore, Karnataka, India
Information Technology
Full-Time
Sagacious Infosystems Pvt ltd
Overview
Job Summary:
We are hiring a skilled Python Developer with hands-on experience in web scraping, IP management, proxy/VPN rotation, and server-edge deployment. The ideal candidate should be well-versed in building scalable scraping solutions while bypassing IP blocks and geo-restrictions.
Key Responsibilities:
- Design and develop robust Python-based web scraping tools using libraries such as Scrapy, Selenium, or BeautifulSoup.
- Implement and manage IP rotation strategies, proxy pools, and VPNs to avoid rate-limiting and bans.
- Set up and maintain server-edge infrastructure to support distributed scraping (e.g., cloud VMs, Dockerized scrapers).
- Monitor scraping health, handle captchas, timeouts, and anti-bot protections (e.g., Cloudflare, Akamai).
- Optimize scripts for performance, concurrency, and low-latency extraction.
- Maintain data integrity and log scraping outcomes.
- Collaborate with data and DevOps teams to ensure smooth pipeline integration.
Required Skills:
- Strong proficiency in Python.
- Experience with web scraping frameworks (Scrapy, Selenium, Requests, BeautifulSoup).
- Knowledge of proxy services, residential IPs, VPNs, and rotating IP strategies.
- Familiarity with handling captchas, headers, user agents, and anti-bot evasion techniques.
- Experience with cloud servers (AWS, Azure, GCP) and tools like Docker, SSH, or CI/CD pipelines.
- Basic understanding of network protocols and HTTP request handling.
Preferred Skills:
- Experience with Tor Network, SOCKS5 proxies, or headless browsers.
- Knowledge of JavaScript rendering (e.g., Puppeteer or Playwright with Python).
- Experience with asynchronous programming (asyncio, aiohttp).
- Familiarity with databases (MongoDB, PostgreSQL) and API integration.
What We Offer:
- Competitive salary + performance-based bonuses.
- Opportunity to work on high-scale data extraction systems.
- Exposure to cutting-edge scraping and proxy technologies.
- Remote-friendly and flexible working environment.
Job Type: Full-time
Pay: ₹20,000.00 - ₹60,000.00 per month
Location Type:
- In-person
Schedule:
- Day shift
- Monday to Friday
Work Location: In person
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in