Senior Consultant | AWS Data engineer | Hyderabad | Engineering

Education

Bachelor’s degree in relevant field (e.g. Engineering, Analytics or Data Science, Computer Science, Statistics) or equivalent experience.

Experience

• At least 6 years of experience with big data technologies like Azure Data Lake, Synapse, PySpark, Azure Data Factory (ADF), AWS Redshift , S3, SQL Server ,MLOps or their equivalent.
• Experience in implementing complex ETL pipelines day-to-day operations.
• Experience on knowledge graphs is a plus.
• 3+ years of experience in Agile Development and code deployment and CI-CD pipelines.
• 2+ years of experience in job orchestration using Airflow or equivalent.
• 2+ years in AI/ML, specially Gen AI concepts on Rag patterns, chunking techniques.
• Exposure on knowledge graphs is a plus.
• Build, Design and Deliver enterprise data programs.
• Proficiency in implementing data quality rules.
• Proficiency in analytical tools like Tableau, Power BI or equivalent.
• Experience with security models and development on large data sets.
• Experience in data quality management tools.
• Work closely with different stakeholders: Business owners, users, product managers, program managers, architects, engineering managers & developers, etc. to translate business needs and product requirements to well-documented engineering solutions.
• Ensuring data quality and consistency: Ensure data quality and consistency across various sources.
• Strong working knowledge on Python.
• Designing and contributing to best practices: Design and contribute to best practices in Enterprise Data Warehouse (EDW) architecture.

Additional Desired Preferences

• 
  Experience with scientific chemistry nomenclature or prior work experience in life sciences, chemistry, or hard sciences or degree in sciences
• Experience with pharmaceutical datasets and nomenclature
• Experience working with knowledge graphs
• Ability to explain complex technical issues to a non-technical audience
• Self-directed and able to handle multiple concurrent projects and prioritize tasks independently
• Able to make tough decisions when trade-offs are required to deliver results
• Strong communication skills required: Verbal, written, and interpersonal