Qubryx - Data Engineer

Job Title : Data Engineer

Location : Kochi

Job Type : Fulltime

Experience : 3+ years

Job Description

We are looking for an experienced Data Engineer to join our team on a contract basis. The ideal candidate will have a strong background in data engineering with hands-on experience in Python, Pandas, and working with Azure Cloud services including Azure Fabric, Azure Data Factory, Azure SQL, and Azure Blob Storage. This role will primarily involve designing and implementing data engineering solutions, building data pipelines, and working with data lakes and some data warehousing. If you have a deep understanding of data modeling and SQL, we would love to hear from you.

Key Responsibilities

• Design, implement, and optimize data pipelines and workflows in Azure Cloud environments.
• Develop and manage data lakes, ensuring efficient data storage, retrieval, and management.
• Work with Azure Data Factory and Azure SQL to integrate data sources and build robust, scalable systems.
• Perform data modeling and optimization for reporting and analytics needs.
• Use Python and Pandas for data transformation, cleaning, and manipulation.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Ensure data security and compliance standards are maintained across all systems.
• Develop and maintain SQL queries to extract, manipulate, and manage large datasets.
• Support troubleshooting and debugging efforts for any data-related issues in the pipeline or platform.
• Create detailed documentation of implemented data solutions and processes.
• Stay up to date with emerging technologies and tools within the data engineering field.
  
  

Required Skills

• Data Engineering experience with a strong focus on cloud-based solutions (Azure).
• Proficiency in Python and Pandas for data transformation and processing.
• Hands-on experience with Azure Cloud services like Azure Data Factory, Azure SQL, Azure Blob Storage, and Azure Fabric.
• Experience working with data lakes and data warehousing solutions.
• Strong SQL skills for managing and querying large datasets.
• Data modeling experience with a focus on optimizing data for analytics and reporting.
• At least 3 years of overall experience in data engineering or related fields.
• Proven ability to design and implement scalable and efficient data architectures.
• Strong analytical and problem-solving skills.
  
  

Preferred Skills

• Oil and Gas industry experience (Added advantage).
• Experience with Power BI or other Azure-based analytics tools.
• Familiarity with data pipeline orchestration and monitoring tools.
• Knowledge of ETL processes and data integration strategies.
• Experience in working in an agile environment.
  
  

Education : Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

(ref:hirist.tech)