Gurugram, Haryana, India
Information Technology
Full-Time
Simform
Overview
Job Description
Key Responsibilities :
Required Skills & Qualifications
Key Responsibilities :
- Design and implement scalable web scraping frameworks to collect data from complex and dynamic websites.
- Develop custom spiders/crawlers using Python libraries like Playwright, Puppeteer, Selenium, Scrapy, or BeautifulSoup.
- Apply advanced anti-bot evasion strategies such as CAPTCHA solving, IP rotation, user-agent spoofing, browser fingerprinting, and session/cookie management.
- Automate scraping tasks across distributed systems using tools like Celery, Airflow, cron, and ETL orchestration platforms.
- Optimize scraper performance for speed, accuracy, and resilience to website structure changes.
- Implement network interception, DOM traversal, WebSocket handling, and headless browser control.
- Store and manage scraped data in cloud or local storage using PostgreSQL, MongoDB, or S3.
- Integrate scraping systems with APIs or microservices for data consumption and downstream workflows.
- Monitor scraper reliability and handle retry logic, error logging, and dynamic throttling.
- Write modular, well-documented, and testable Python code with proper unit testing and
- Collaborate with engineers, data scientists, and stakeholders to understand scraping goals
Required Skills & Qualifications
- Bachelors/Masters degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in Python development with specialization in web scraping.
- Deep understanding of modern anti-scraping defenses and bypass techniques (e.g., CAPTCHA, IP bans, dynamic rendering).
- Proficiency with headless browser tools like Playwright, Puppeteer, or Selenium.
- Strong grasp of DOM manipulation, JavaScript execution, network inspection, and asynchronous scraping using asyncio, aiohttp, etc.
- Experience in handling large-scale data extraction and storage using SQL and NoSQL databases.
- Hands-on experience deploying scrapers and automation workflows on AWS, GCP, or Azure.
- Familiarity with containerization using Docker and optional experience with Kubernetes.
- Comfortable with REST API integration, job scheduling, and microservices-based
- Strong debugging, optimization, and testing skills.
- Clear understanding of legal and ethical scraping boundaries.
Similar Jobs
View All
1 Day ago
Program Manager
Information Technology
- 15 - 18 Yrs
- Gurgaon / Gurugram
We’re Hiring | Program Manager
Location: Gurugram, India
Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain
Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
1 Day ago
Technical Fullstack Architect - Node.js
Information Technology
- 50,00,000 - 60,00,000 INR - Annual
- 12 - 18 Yrs
- Hyderabad
About the Role:
We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
1 Day ago
Principal Engineer - Fullstack
Information Technology
- 30,00,000 - 40,00,000 INR - Annual
- 8 - 12 Yrs
- Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually
Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
1 Day ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
- 4,00,000 - 8,00,000 INR - Yearly
- 4 - 8 Yrs
- West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
1 Day ago
Software Developer
Cybersecurity & Privacy
- 2 - 5 Yrs
- Gujarat, Maharashtra
Summary role description:
Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML.
Company description:
Our client is a US-headquartere...
2 Days ago
Axis My India - Data Analyst - Python/Pandas
Pharmaceuticals
- Hyderabad, Telangana, India
About The CompanyAxis My India is Indias foremost Consumer Data Intelligence Company, which in partnership with Google is building a single-stop People Empowerment Platform, the a app, that aims to change peoples awareness, accessibility, and utiliz...
2 Days ago
Data Engineer
Pharmaceuticals
- Hyderabad, Telangana, India
Job Title - Data EngineerAbout TazapayTazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anyw...
2 Days ago
Master Data Analyst – Application Support
Pharmaceuticals
- Hyderabad, Telangana, India
About Inchcape Shipping ServicesAt Inchcape, our vision is to have a connected world, in which our customers trade successfully and make better decisions in every port, everywhere. We use technology and our global network to help our partners connec...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in