Sr. Data Engineer

Description

About Norstella

At Norstella, our mission is simple: to help our clients bring life-saving therapies to market quicker—and help patients in need.

Founded in 2022, but with history going back to 1939, Norstella unites best-in-class brands to help clients navigate the complexities at each step of the drug development life cycle —and get the right treatments to the right patients at the right time.

Each Organization (Citeline, Evaluate, MMIT, Panalgo, The Dedham Group) Delivers Must-have Answers For Critical Strategic And Commercial Decision-making. Together, Via Our Market-leading Brands, We Help Our Clients

• Citeline – accelerate the drug development cycle
• Evaluate – bring the right drugs to market
• MMIT – identify barrier to patient access
• Panalgo – turn data into insight faster
• The Dedham Group – think strategically for specialty therapeutics
  
  
  

By combining the efforts of each organization under Norstella, we can offer an even wider breadth of expertise, cutting-edge data solutions and expert advisory services alongside advanced technologies such as real-world data, machine learning and predictive analytics.

As one of the largest global pharma intelligence solution providers, Norstella has a footprint across the globe with teams of experts delivering world class solutions in the USA, UK, The Netherlands, Japan, China and India.

The Team

The Data Engineering team in Panalgo support petabyte scale big data systems. Our customers require analysis of large datasets from disparate sources. As a part of the data engineering team you will be optimizing the processing systems and delivering ETL jobs to efficiently transform these datasets to proprietary format for analysis. You will be working closely with other talented engineers and driving technical implementation of complex data applications.

Scope and Summary

We are seeking a highly skilled Senior Engineer to join our software engineering team. This role is ideal for and engineer who has a large breadth of knowledge in different tech system and also has a deep knowledge of ETL using spark and Hadoop. You will be working closely with other engineers, and helping them by tackling challenging optimization and coding issues.

 

• Handle complex bugs and application development in Java, Ruby and Python languages
• Maintain a legacy Ruby/Java based ETL framework
• Optimize various ETL / Mapping tasks for efficiency and speed
• Guide junior team members in solving complex technical problems
• Implement proof of concept work for new technology and framework
• Support production application by building observability into the system
• Find ways to optimize and automate data ETL processes under the team’s purview
  
  
  

Qualification

• Minimum 5 years experience in data ETL of large datasets
• Expert in Java and Python for data processing
• Experience with data analytics using big data technologies
• Well versed in Spark and Hadoop programming
• Experience with AWS cloud services for ETL. Has a good understanding of permissions and privileges, networking in AWS cloud.
• Well versed in modern SDLC based on containerization, CI/CD  
• Has good knowledge of SQL (redshift, snowflake or others)
• Can learn new languages, domain and systems quickly
• Comfortable working in legacy codebase and reverse engineering code to get to the bottom of issues
  
  
  

Preferred

• Experience in Ruby
• Linux scripting and automation
• US healthcare knowledge