Bangalore, Karnataka, India
Information Technology
Full-Time
BEO Software Private Limited
Overview
Responsibilities
Role objective: Build data pipelines (crawling/parsing, deduplication/delta, embeddings) and connect external systems and interfaces.
Tasks
Role objective: Build data pipelines (crawling/parsing, deduplication/delta, embeddings) and connect external systems and interfaces.
Tasks
- Development of crawling/fetch pipelines (API-first; playwright/requests only where permitted)
- Parsing/normalization of job postings & CVs, deduplication/delta logic (seen hash, repost heuristics)
- Embeddings/similarity search (controlling Azure OpenAI, vector persistence in pgvector)
- Integrations: HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP
- Batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues
- Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items)
- Collaboration with FE for exports (CSV/Excel, presigned URLs) and admin configuration
- 4+ years of backend/data engineering experience
- Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium), solid TypeScript for smaller services/SDKs
- Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics
- Messaging: Service Bus/Queues, idempotence & exactly-once semantics, pragmatic approach
- Databases: PostgreSQL, pgvector, query design & performance tuning
- Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry)
- NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract)
- Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies (legally compliant)
- Working method: API-first, clean code, trunk-based development, mandatory code reviews
- Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence
- On-call/support: rotating, "you build it, you run it"
Similar Jobs
View All
1 Day ago
Automation DevOps Engineer / Senior Consultant Specialist
Information Technology
About the job:Key responsibilities: 1 - Work closely with product and delivery teams to support BAU and project deliveries. 2 - Collaborate with architects to plan and design effective technical solutions. 3 - Manage compliance and address vulnerab...
1 Day ago
Software Engineer – Enterprise Switching
Information Technology
About the job:Key responsibilities: 1. Contribute your talents to Cisco's Switching technology, the networking equipment of choice for large enterprises. 2. Develop and integrate products used by leading enterprises worldwide. 3. Collaborate with...
1 Day ago
VAYUZ Technologies - Java Developer - Microservices Architecture
Information Technology
Job DescriptionKey Responsibilities : Design, develop, and maintain Java-based microservices solutions. Build and integrate services leveraging Kafka for real-time event streaming. Participate in solution design discussions, ensuring scalable and...
1 Day ago
Consultant Technical Lead - MSSQL DBA Admin & Public Cloud Expert
Information Technology
Reference 25000HEOResponsibilitiesWe are seeking a highly skilled Cloud Developer & Support Engineer to design, develop, and support our cloud-based products and infrastructure. The ideal candidate will have deep technical expertise in AWS and Azure...
1 Day ago
Senior Software Engineer
Information Technology
About the job:Key responsibilities: 1. Develop and integrate products used by leading enterprises worldwide. 2. Work on the IOS XE OS, the backbone of many enterprise devices. 3. Collaborate with a vibrant technical community and learn from domai...
1 Day ago
XTEN-AV - Full Stack Developer - Python/Django
Information Technology
Full Stack DeveloperLocation : NoidaCompany : XTEN-AVAbout XTEN-AVXTEN-AV is a leading professional AV design platform that leverages AI to automate AV drawings and documentation. Our platform empowers AV designers, integrators, and manufacturers to...
1 Day ago
Customer Crisis Business Analyst
Information Technology
Amex GBT is a place where colleagues find inspiration in travel as a force for good and – through their work – can make an impact on our industry. We’re here to help our colleagues achieve success and offer an inclusive and collaborative culture whe...
1 Day ago
Senior Manager, DevOps Engineer
Information Technology
Job DescriptionSenior Manager, DevOps EngineerThe Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achi...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in