Gurugram, Haryana, India
Information Technology
Full-Time
HSBC
Overview
About The Role
We are looking for a highly skilled and experienced Senior Data Engineer to join our team in Hyderabad. The ideal candidate will bring strong technical expertise in building scalable data platforms and pipelines using modern technologies such as Python, Scala, AWS, Redshift, Terraform, Jenkins, and Docker. This role demands a hands-on professional who thrives in a fast-paced, collaborative environment and is eager to solve complex data problems.
Key Responsibilities
We are looking for a highly skilled and experienced Senior Data Engineer to join our team in Hyderabad. The ideal candidate will bring strong technical expertise in building scalable data platforms and pipelines using modern technologies such as Python, Scala, AWS, Redshift, Terraform, Jenkins, and Docker. This role demands a hands-on professional who thrives in a fast-paced, collaborative environment and is eager to solve complex data problems.
Key Responsibilities
- Design, build, and optimize robust, scalable, and secure data pipelines and platform components.
- Collaborate with data scientists, analysts, and engineering teams to ensure seamless data flow, integration, and availability across systems.
- Develop infrastructure as code using Terraform to automate provisioning and environment management.
- Manage containerized services and workflows using Docker.
- Set up, manage, and optimize CI/CD pipelines using Jenkins for continuous integration and deployment.
- Optimize performance, scalability, and reliability of large-scale data systems on AWS.
- Write clean, modular, and efficient code in Python and Scala to support ETL, data transformation, and processing tasks.
- Support data architecture planning and participate in technical reviews and design sessions.
- Strong hands-on experience with Python, Scala, SQL, and Amazon Redshift.
- Proven expertise in AWS cloud services and ecosystem (EC2, S3, Redshift, Glue, Lambda, etc.).
- Experience implementing Infrastructure as Code (IaC) with Terraform.
- Proficient in managing and deploying Docker containers in development and production environments.
- Hands-on experience with CI/CD pipelines using Jenkins.
- Strong understanding of data architecture, ETL pipelines, and distributed data processing systems.
- Excellent problem-solving skills and ability to mentor junior engineers.
- Experience working in regulated domains like healthcare or finance.
- Exposure to Apache Airflow, Spark, or Databricks.
- Familiarity with data quality frameworks and observability tool
Similar Jobs
View All
4 Hours ago
Web Developer ( AI-Assisted )
Information Technology
- 1 - 4 Yrs
- Anywhere in India/Multiple Locations
About the Role
Were hiring a self-driven Web Developer who can build modern, scalable websites and applications using AI tools like ChatGPT, Claude, Gemini, and more to accelerate development.
You should be comfortable using these tools to write, d...
4 Hours ago
Web Developer ( AI-Assisted )
Information Technology
- 1 - 4 Yrs
- Anywhere in India/Multiple Locations
About the Role
Were hiring a self-driven Web Developer who can build modern, scalable websites and applications using AI tools like ChatGPT, Claude, Gemini, and more to accelerate development.
You should be comfortable using these tools to write, d...
4 Hours ago
Dotnet Developer
Information Technology
- 1 - 6 Yrs
- Anywhere in India/Multiple Locations
JOB DESCRIPTION / RESPONSIBILITIES
Develop, test, and deploy high-quality web applications using .NET Core, ASP.NET Core, and other related technologies.
Collaborate with cross-functional teams to analyze, design, and implement software solut...
1 Day ago
Cyber Security Analyst
Information Technology
- 2 - 7 Yrs
- Mumbai, Navi Mumbai, Thane, Nagpur, Nashik, Pune
Job Description
Functional responsibility: Who ensures all the security parameters of a network are intact at any given point in time
He analyses the security requirements of a new network or a network that requires an upgrade
And the...
1 Day ago
Software Engineer
Information Technology
- 2 - 7 Yrs
- Kolkata
Role - Software Engineer
Experience -2 to 7 Years
Location - Kolkata Hybrid
JOB DESCRIPTION:
As a software engineer, you will collaborate with a team of talented individuals to create products
that change the way restaurant operato...
1 Day ago
Software Engineer
Information Technology
- 3 - 10 Yrs
- Chennai
JOB DESCRIPTION:
As a software engineer, you will collaborate with a team of talented individuals to create products
that change the way restaurant operators manage their enterprise. We’re looking for ideas from
every facet of computer scien...
1 Day ago
Interesting Job Opportunity: Senior Data Engineer - Python/SQL
Information Technology
- Hyderabad, Telangana, India
Role : Senior Data EngineerThis is a full-time position with D Square Consulting Services Pvt LtdLocation : Bangalore (Hybrid)Experience : 5+ yearsNotice Period : Candidates available to join within 15 days are preferredJob SummaryWe are seeking a s...
1 Day ago
Sr. Software Engineer - Python Job
Information Technology
- Hyderabad, Telangana, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in