Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer

decor
Information Technology
Full-Time
algoleap

Overview

About The Role

We are seeking a highly experienced and passionate Data Engineer to join our growing data team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our robust data infrastructure, ensuring data quality, availability, and scalability. You will play a critical role in empowering our data-driven decision-making by building and optimizing data pipelines, ETL processes, and data warehousing solutions. This is a senior-level position requiring extensive experience with database technologies, data modelling, and cloud platforms.

Responsibilities

  • Data Pipeline Development & Maintenance: Design, build, and maintain end-to-end data pipelines for ingesting, processing, and transforming large datasets from various sources (e.g., relational databases, APIs, flat files, streaming data).
  • ETL/ELT Process Optimization: Develop and optimize ETL/ELT processes using industry-standard tools and techniques, ensuring data accuracy, efficiency, and scalability.
  • Database Design & Management: Design, implement, and manage relational databases, including schema design, indexing, performance tuning, and data governance.
  • Data Warehousing: Design and implement data warehousing solutions to support business intelligence and reporting needs. Experience with star schema, snowflake schema, and other data modelling techniques is essential.
  • Database Administration: Perform database administration tasks, including performance monitoring, capacity planning, backup and recovery, and security management.
  • Data Quality & Governance: Implement data quality checks, validation rules, and data governance policies to ensure data accuracy and consistency.
  • Cloud Platform Expertise: Leverage cloud platforms (e.g., AWS, Azure, GCP) for data storage, processing, and management.
  • Collaboration & Communication: Collaborate with cross-functional teams (e.g., data scientists, business analysts, software engineers) to understand data requirements and deliver effective data solutions. Clearly communicate technical concepts to both technical and non-technical audiences.
  • Mentoring & Knowledge Sharing: Mentor junior engineers and share knowledge and best practices within the team.
  • Automation & Scripting: Automate data engineering tasks using scripting languages (e.g., Python, Bash).
  • Stay Up to Date: Continuously research and evaluate new data technologies and techniques to improve our data infrastructure.
  • Production Support: Monitoring the batch/jobs daily, no matter it’s weekdays or weekend.
  • Production Release: Actively participation in release process.

Qualifications

  • Experience: Minimum of 10 years of experience as a Data Engineer or in a similar role.
  • Database Expertise:
  • Expert proficiency in SQL Server: Extensive experience with SQL Server, including database design, performance tuning, query optimization, and database administration.
  • Expert proficiency in PostgreSQL: Deep understanding of PostgreSQL, including database design, performance tuning, query optimization, and database administration.
  • Solid experience with other relational databases like MySQL, Oracle, etc. is a plus.
  • ETL/ELT Tools: Proven experience with ETL/ELT tools (e.g., Apache Airflow, Informatica, Talend, SSIS, ADF etc.).
  • Data Modelling: Strong understanding of data modelling principles and techniques (e.g., dimensional modelling, star schema, snowflake schema).
  • Cloud Computing: Experience with cloud platforms (AWS, Azure, or GCP) and related data services (e.g., S3, Redshift, Snowflake, Azure Data Lake Storage).
  • Programming & Scripting: Proficiency in scripting languages such as Python, Bash, or similar.
  • Data Governance & Quality: Experience implementing data quality checks, data governance policies, and data validation rules.
  • Problem-Solving & Analytical Skills: Excellent problem-solving and analytical skills with the ability to identify and resolve complex data-related issues.
  • Communication & Collaboration: Excellent communication, collaboration, and interpersonal skills. Ability to work effectively in a team environment.
  • Education: Bachelor’s or master’s degree in computer science, Information Technology, or a related field.

Bonus Points

  • Experience with data streaming technologies (e.g., Kafka, Spark Streaming).
  • Experience with data visualization tools (e.g., Tableau, Power BI, Looker).
  • Relevant certifications (e.g., AWS Certified Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
Share job
Similar Jobs
View All
5 Hours ago
Software Engineer - C#/Javascript
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Job Description : We are searching for a Software Engineer who is experienced in C#, .NET technologies, and web technologies (Angular, Aurelia). Join our collaborative team, where you'll work together on exciting projects, designing, building, and...
decor
5 Hours ago
Node.js Developer
Information Technology
  • 2 - 6 Yrs
  • Anywhere in India/Multiple Locations
Job Description: We are looking for a skilled Node.js Developer to join our backend engineering team. The ideal candidate will be responsible for building scalable server-side applications, working on API development, and integrating with database...
decor
6 Hours ago
Frontend Developer
Information Technology
  • 2 - 7 Yrs
  • Anywhere in India/Multiple Locations
Experience Level: 2+ Years Employment Type: Full-Time About the Role: We are looking for a talented Frontend Developer with expertise in React.js to build interactive and responsive web interfaces. You will work closely with backend developers,...
decor
1 Day ago
Business Analyst (PDM) (H/F) - AIRBUS INDIA PRIVATE LIMITED
Information Technology
Job Description: Role: Business Analyst (PDM) Description: The Business Analyst - PDM is part of IIDPPT siglum located in India. He/she is responsible for the PDM and PDM related legacy products here in India. Success of this position will requir...
decor
1 Day ago
Automation Test Lead - Senior Associate - Operate
Information Technology
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to ...
decor
1 Day ago
Canvas App, Power Apps, Power automation / Senior Software Engineer
Information Technology
Job DescriptionSome careers shine brighter than others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new ...
decor
1 Day ago
CCaaS Business Analyst-Senior Associate
Information Technology
A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabi...
decor
1 Day ago
Sustainability- Technology & Innovation - Full Stack Developer (Gen AI & Cloud) - Senior Associate
Information Technology
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media