Free cookie consent management tool by TermsFeed Principal Data Engineer | Antal Tech Jobs
Back to Jobs
1 Day ago

Principal Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
Atorus

Overview

full-time

remote from anywhere in India

Description

The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Research and Development. The Principal will support data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD and Omics.

Essential Functions

  • Support the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform.
  • Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and other tools.
  • Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift.
  • Build and maintain standard data models.
  • Develop data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines.
  • Implement data versioning and lineage tracking to support data traceability, regulatory compliance and audit requirements.
  • Create and maintain documentation for data processes, architectures, and workflows.
  • Implement modern software development best practices (e.g. Code Versioning, DevOps, CD/CI).
  • Maintain compliance with data privacy regulations such as HIPAA, GDP
  • May be required to develop, deliver or support data literacy training across R&D.

Required Knowledge, Skills And Abilities

  • Strong knowledge of data engineering tools such as Python, R and SQL for data processing.
  • Strong proficiency with AWS services particularly S3, Redshift, FSx, Glue, Lambda.
  • Strong proficiency with relational databases.
  • Strong background in data modeling and database design.
  • Familiarity with unstructured database technologies (e.g. NoSQL) and other database types (e.g. Graph).
  • Familiarity with Containerization such as Docker and EKS/Kubernetes.
  • Familiarity with one or more RnD research process and associated regulatory requirements.
  • Exposure to healthcare data standards (CDISC, HL7, FHIR, SNOMED CT, OMOP, DICOM).
  • Exposure to big data technologies and handling.
  • Knowledge of machine learning operations (MLOps) and model deployment.
  • Strong problem-solving and analytical abilities.
  • Excellent communication and collaboration skills.
  • Experience working in an Agile development environment.

Minimum Requirements

  • Bachelor’s Degree in Computer Science, Statistics, Mathematics, Life Sciences, or other relevant scientific fields; Master’s Degree preferred
  • 3-5 years of experience in data engineering, with at least 1.5 years focusing on healthcare, research or clinical related data

Share job
Similar Jobs
View All
1 Day ago
Java Full Stack Developer
Information Technology
  • Bangalore, Karnataka, India
Primary Skill - Java, Springboot, Angular, React.js Responsibilities: Lead and mentor a team of Java & Springboot Developers in the design, development, and maintenance of applications. Work with business stakeholders and technical teams to gather...
decor
1 Day ago
Python Developer, Analyst, Firm Risk Management
Information Technology
  • Bangalore, Karnataka, India
Morgan StanleyPython Developer - AnalystProfile DescriptionWe’re seeking someone to join our team as (Analyst - Python Developer) in (Credit Risk) division.Firm Risk ManagementIn the Firm Risk Management division, we advise businesses across the Fir...
decor
1 Day ago
Junior SQL Developer/Software Integration Specialist
Information Technology
  • Bangalore, Karnataka, India
Position : Junior SQL Developer / Software Integration SpecialistLocation : MumbaiExperience : Fresher or 1 Year of Relevant ExperienceJob Type : Full-timeDepartment : IT / DevelopmentKey skills : Sybase Power Builder/PB 6.5 /POWER BUILDERJob Overvi...
decor
1 Day ago
Agile Coach
Information Technology
  • Bangalore, Karnataka, India
Job PurposeResponsible to ensure a successful Agile adoption within the organization and thereby within the scrum teams and within the different organization disciplines. Lead the way to better deliver done-high-quality products, through continuous ...
decor
1 Day ago
Python Developer - Data Platform
Information Technology
  • Bangalore, Karnataka, India
Key Responsibilities Develop, maintain, and optimize robust data ingestion and ETL/ELT pipelines using Python on the Databricks platform. Work collaboratively with the architecture team to align implementation with long-term data strategies. Leve...
decor
1 Day ago
AWS Admin And AWS Architect
Information Technology
  • Bangalore, Karnataka, India
Primary skills:Technology->IOT Platform->AWS IOT A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and fa...
decor
1 Day ago
Machine Learning Engineer - Data Modeling
Information Technology
  • Bangalore, Karnataka, India
Role : Machine Learning and AI EngineerExp : 4+ YearsType : HybridLocation : Bangalore We are looking for a skilled Mid-Level AI Engineer with extensive experience in building full-stack AI solutions. The ideal candidate will have a strong foundat...
decor
1 Day ago
Interesting Job Opportunity: Target Integration - Principal Software Engineer - Node.js/Python
Information Technology
  • Chennai, Tamil Nadu, India
Key Responsibilities Drive the end-to-end architecture, design, and implementation of robust, scalable, and secure software systems. Define technical standards, frameworks, and best practices, ensuring delivery excellence. Collaborate with stakeh...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media