Information Technology
Full-Time
AKIRA Insights
Overview
About The Role
We are seeking a highly skilled Web Scraping & Python API Developer to build and maintain scalable data extraction systems from various websites and APIs. The ideal candidate has hands-on experience with web scraping frameworks, RESTful API development, and data integration techniques.
Responsibilities
We are seeking a highly skilled Web Scraping & Python API Developer to build and maintain scalable data extraction systems from various websites and APIs. The ideal candidate has hands-on experience with web scraping frameworks, RESTful API development, and data integration techniques.
Responsibilities
- Design and develop robust, scalable web scraping scripts using Python (e.g., Scrapy, BeautifulSoup, Selenium).
- Build and maintain RESTful APIs to serve scraped data to internal systems or clients.
- Handle anti-bot mechanisms like CAPTCHAs, JavaScript rendering, and IP rotation.
- Optimize scraping processes for speed, reliability, and data integrity.
- Parse and normalize structured and unstructured data (HTML, JSON, XML).
- Monitor and maintain scraping pipelines; handle failures and site structure changes.
- Implement logging, error handling, and reporting mechanisms.
- Collaborate with product managers and data analysts to define data requirements.
- Ensure compliance with website terms of service and data use regulations.
- 3+ years of experience with Python, especially in data extraction and web automation.
- Strong knowledge of web scraping libraries (Scrapy, BeautifulSoup, Requests, Selenium).
- Experience with REST API development (FastAPI, Flask, or Django REST Framework).
- Proficient with data handling libraries (Pandas, JSON, Regex).
- Experience working with proxies, headless browsers, and CAPTCHA solving tools.
- Familiarity with containerization (Docker) and deployment on cloud platforms (AWS, GCP, Azure).
- Strong understanding of HTML, CSS, JavaScript (from a scraping perspective).
- Experience with version control (Git) and agile development methodologies.
- Experience with GraphQL scraping.
- Familiarity with CI/CD pipelines and DevOps tools.
- Knowledge of data storage solutions (PostgreSQL, MongoDB, Elasticsearch).
- Prior experience with large-scale web crawling infrastructure.
- Competitive salary and performance bonuses.
- Flexible work hours and remote work option.
- Opportunity to work on high-impact, data-driven products.
- Learning budget for conferences, books, and courses.
Similar Jobs
View All
1 Day ago
PHP Developer
Information Technology
- 3 - 7 Yrs
- Anywhere in India/Multiple Locations
We are looking for Senior PHP Developer, capable of developing high-end web applications using PHP ,MY SQL & CodeIgniter. Working knowledge in API Integrations for E-commerce portals preferred.
Required Candidate profile
3+ years Exp. with P...
1 Day ago
Java Developer
Information Technology
- 2 - 5 Yrs
- Anywhere in India/Multiple Locations
Role - Software Engineer (Java Developer)
Years of Experience - 2 to 5
Work Mode - Remote
Bachelors degree in computer science, Engineering, or a related field.
2 to 5 years of experience in Java development.
Proficiency in Java, with...
1 Day ago
Sr Engineer II (C++ Developer)
Information Technology
- Pune, Maharashtra, India
Seeking a highly motivated and self-driven Software Developer who will be responsible for developing slot content for Digital applications (Heart of Vegas, Cashman Casinos & Lightning Link) across various platforms (iOS, Android and Web).Quick Learn...
1 Day ago
Freelance UI Developer (Client Hire)
Information Technology
- Pune, Maharashtra, India
Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organisations seeking independent talent. Flexing It has partnered with ur client, a leading Procurement intelligence company which deals in...
1 Day ago
Network Engineer
Information Technology
- Pune, Maharashtra, India
OverviewRapiscan Systems is an industry leader in detection technology, providing cargo and vehicle inspection systems and services for ports, borders, military, high-threat facilities, and checkpoints to help customers combat terrorism, drug smuggl...
1 Day ago
Senior Software Engineer
Information Technology
- Pune, Maharashtra, India
OverviewWorking at AtlassianAtlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire ...
1 Day ago
Cloud Platform Engineer
Information Technology
- Pune, Maharashtra, India
Project Role : Cloud Platform EngineerProject Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof ...
1 Day ago
Application Developer
Information Technology
Project Role : Application DeveloperProject Role Description : Design, build and configure applications to meet business process and application requirements.Must have skills : React.jsGood to have skills : NAMinimum 7.5 Year(s) Of Experience Is Req...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in