Hyderabad, Telangana, India
Healthcare & Life Sciences
Full-Time
CustomerLabs 1P Data OPs
Overview
Responsibilities
Develop, and maintain scalable data pipelines and ETL processes to ingest, process, and store data from various sources.
Implement data transformation and cleaning processes to ensure data quality and consistency.
Integrate data from diverse sources including APIs, databases, and third-party services.
Ensure seamless data flow between systems and platforms.
Troubleshoot and resolve issues related to data processing and data quality.
Collaborate with software engineers to integrate data solutions into existing applications and systems.
Maintain comprehensive documentation of data pipelines, architectures, and processes.
Provide regular status updates and reports on data engineering projects and performance metrics.
Implement data security measures and ensure compliance with relevant data protection regulations and policies.
Stay current with industry trends, technologies, and best practices in data engineering.
Recommend and implement new tools and technologies to improve data engineering processes and capabilities.
Qualifications
Proven experience of 2 to 3yrs as a Data Engineer or similar role(Software Developer, Backend developer) with a strong understanding of data engineering principles and practices.
Familiarity with cloud platforms -Google Cloud.
Proficiency in programming languages such as Python, Golang, Nodejs.
Experience with data modeling, ETL processes, and data warehousing solutions.
Hands-on experience with big data technologies such as Apache Spark, Apache Kafka.
Knowledge in AI Code Generation
Hands on experience in tools like Copilot, Cursor, Claude, etc.,
Strong knowledge of SQL and experience with relational and NoSQL databases.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
Preferred Skills
Experience with microservices
Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
Experience with Bigquery, Pubsub, Dataflow, Apache Airflow
Experience with CI/CD Framework tools such as Jenkins, Travis CI , Github Actions etc.
Develop, and maintain scalable data pipelines and ETL processes to ingest, process, and store data from various sources.
Implement data transformation and cleaning processes to ensure data quality and consistency.
Integrate data from diverse sources including APIs, databases, and third-party services.
Ensure seamless data flow between systems and platforms.
Troubleshoot and resolve issues related to data processing and data quality.
Collaborate with software engineers to integrate data solutions into existing applications and systems.
Maintain comprehensive documentation of data pipelines, architectures, and processes.
Provide regular status updates and reports on data engineering projects and performance metrics.
Implement data security measures and ensure compliance with relevant data protection regulations and policies.
Stay current with industry trends, technologies, and best practices in data engineering.
Recommend and implement new tools and technologies to improve data engineering processes and capabilities.
Qualifications
Proven experience of 2 to 3yrs as a Data Engineer or similar role(Software Developer, Backend developer) with a strong understanding of data engineering principles and practices.
Familiarity with cloud platforms -Google Cloud.
Proficiency in programming languages such as Python, Golang, Nodejs.
Experience with data modeling, ETL processes, and data warehousing solutions.
Hands-on experience with big data technologies such as Apache Spark, Apache Kafka.
Knowledge in AI Code Generation
Hands on experience in tools like Copilot, Cursor, Claude, etc.,
Strong knowledge of SQL and experience with relational and NoSQL databases.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
Preferred Skills
Experience with microservices
Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
Experience with Bigquery, Pubsub, Dataflow, Apache Airflow
Experience with CI/CD Framework tools such as Jenkins, Travis CI , Github Actions etc.
Similar Jobs
View All
1 Day ago
Travelxp - Senior Software Developer - Backend Technologies
Information Technology
- Mumbai, Maharashtra, India
About The JobJob Title : Senior Software DeveloperLocation : Mumbai OnsiteExperience : 2-3 yearsRole OverviewWe are looking for a Senior Software Developer - Backend Focus who's passionate about building robust, scalable systems and pushing the boun...
1 Day ago
Technical Lead
Information Technology
- Mumbai, Maharashtra, India
Tech Lead(Fullstack) - Nexa (Conversational Voice AI Platform)Location : Bangalore Type: Full-timeExperience : 4+ years (preferably in early-stage startups)Tech Stack : Python (core), Node.js, React.jsAbout NexaNexa is a new venture by the founders ...
1 Day ago
Sr. Software Engineer - .NET C# Job
Information Technology
- Mumbai, Maharashtra, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
Zinnia - Senior Data Scientist - Analytics/Python
Information Technology
- Mumbai, Maharashtra, India
Who We AreZinnia is the leading technology platform for accelerating life and annuities growth.With innovative enterprise solutions and data insights, Zinnia simplifies the experience of buying, selling, and administering insurance products.All of w...
1 Day ago
Senior Data/BI Engineer - Tableau/Power BI
Information Technology
- Mumbai, Maharashtra, India
What You'll Do Data Analytics & Modeling : Apply strong Data Analytics and Analytical Skills to understand complex business requirements and translate them into effective Data Modeling solutions. Data Pipeline Development : Design, develop, and ma...
1 Day ago
BigStep Technologies - Artificial Intelligence/Machine Learning Engineer - LLM Models
Information Technology
- Mumbai, Maharashtra, India
Responsibilities Research, design, develop, and test Python code. Collaborate with the Product and Data Science teams to define core AI/ML platform features. Understand business requirements, functional specifications, and research pre-trained mo...
1 Day ago
TIFIN - IT System Administrator
Information Technology
- Mumbai, Maharashtra, India
ResponsibilitiesWe are looking for a proactive and detail-oriented Systems Administrator - IT Operations to join our team in Mumbai. In this role, you will be responsible for managing IT infrastructure, ensuring system uptime, supporting end-user de...
1 Day ago
Markovate - Senior Data Engineer - Spark/Hadoop
Information Technology
- Mumbai, Maharashtra, India
About Markovate.At Markovate, we dont just follow trendswe drive them.We transform businesses through innovative AI and digital solutions that turn vision into reality.Our team harnesses breakthrough technologies to craft bespoke strategies that ali...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in