Free cookie consent management tool by TermsFeed Lead Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Lead Data Engineer

decor
Chennai, Tamil Nadu, India
Information Technology
Full-Time
CBRE

Overview

Gurgaon - Haryana - India, Hyderabad - Telangana - India, Noida - Uttar Pradesh - India

About The Role


As a Senior Lead Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipeline and infrastructure. You will work closely with stakeholders, analysts, and other to ensure data integrity, availability, and security. This position requires a deep understanding of data engineering principles, advanced technical skills, and the ability to build data pipelines & ingestion workflows.

What You’ll Do


  • Design, develop, and maintain robust data pipelines and ETL processes to collect, process, and store large volumes of data from various sources.
  • Experience in building and maintaining the existing data acquisition scripts using Go Language.
  • Collaborate with stakeholders/product owners and analysts to understand data requirements and translate them into scalable solutions.
  • Optimize and improve existing data solutions for better performance and scalability.
  • Ensure data consistency, security and accuracy through data validation and cleansing techniques.
  • Implement and maintain data warehouse solutions, including data modelling, schema design, and query optimization.
  • Develop and maintain data integration solutions to support business intelligence and analytics needs.
  • Monitor and troubleshoot data pipeline issues, ensuring timely resolution.
  • Stay updated with the latest trends and technologies in data engineering and recommend improvements.
  • Configure and monitor continuous integration/continuous deployment (CI/CD) pipelines and tools (e.g., Git, Jenkins).
  • Mentor and provide technical guidance to junior data engineers.
  • Proven ability to work independently and with a team.
  • Document data processes, workflows, and best practices.

What You’ll Need


  • Bachelor’s or master’s degree in computer science, Engineering, or a related field.
  • 10+ years of experience in data engineering, data warehousing, or a related field.
  • Strong Hands-on experience on advanced Snowflake and PostgreSQL.
  • Experienced at handling Data Warehouse technologies like Snowflake.
  • Creating Integration with AWS S3.
  • Configuring Data ingestion pipelines.
  • Proficiency in programming languages such as Python, Go Language.
  • Experience with cloud platforms (e.g., AWS, Azure) and their data services.
  • Strong experience on data integration techniques, data modelling and ETL processes.
  • Familiarity with data visualization tools (e.g., Tableau, Power BI) is a plus.
  • Experience with real-time data processing and stream processing frameworks.
  • Experience in configuring CI/CD pipelines and version control like GIT.
  • Knowledge of containerization and orchestration tools.
  • Knowledge of NLP and machine learning concepts.
  • Understanding of data governance and compliance regulations.
  • Strong problem-solving skills and the ability to work independently or as part of a team.
  • Adaptability and a willingness to learn new technologies and techniques.
  • Excellent communication and interpersonal skills.

Service line: Corporate Segment
Share job
Similar Jobs
View All
1 Day ago
BI Data Analyst/Specialist 3
Information Technology
  • Chennai, Tamil Nadu, India
Job Title : BI Data Analyst/Specialist 3Company Overview:Mastek is a global digital transformation provider, committed to delivering innovative solutions that drive success for our clients. We focus on leveraging advanced technology and a strong cul...
decor
1 Day ago
Senior Technical Support Engineer - CX
Information Technology
  • Chennai, Tamil Nadu, India
Job RequirementsOur purpose is to help a billion people find the right work! Phenom is an AI-Powered talent experience platform that is redefining the HR tech space. We have grown into a global organization with offices in 6 countries and over 1,500...
decor
1 Day ago
Network Engineer - CCNA Certified
Information Technology
  • Chennai, Tamil Nadu, India
About UsRV Solutions Pvt.Ltd. is such a leading Technology Lifecycle Service provider, established in 2008 to render Services in Telecom Domain, Mobile After Sales Service, IT Software Solutions, and IT Hardware support for organizations in India.In...
decor
1 Day ago
Techies Infotech - DevOps Engineer - AWS Cloud Services
Information Technology
  • Chennai, Tamil Nadu, India
About The RoleWe are looking for a DevOps Engineer with hands-on experience in AWS cloud, e-commerce platforms, and modern application stacks. You will support development and operations teams by ensuring reliable deployments, automation, monitoring...
decor
1 Day ago
ChicMic Studios - Data Scientist - Python
Information Technology
  • Chennai, Tamil Nadu, India
Experience Required : 1-3 YearsNo. of vacancies : 4Job Type : Full TimeVacancy Role : WFOJob Category : DevelopmentJob DescriptionWe are seeking a Data Scientist with strong expertise in data analysis, machine learning, and visualization. The ideal ...
decor
1 Day ago
Noww - Java Full Stack Developer
Information Technology
  • Chennai, Tamil Nadu, India
Position : Full Stack Java Developer with React : Remote OK / Hybrid preferred Hyderabad, Indore, or : 6-7 Duration : 6 months : C2CRole OverviewWe are seeking a highly skilled Backend Developer / Full Stack Java Developer with strong experience in ...
decor
1 Day ago
Senior Software Engineering Lead - front end developer react js, node js
Information Technology
  • Chennai, Tamil Nadu, India
Design and develop high-quality, scalable, and resilient web applications using Java and modern JavaScript frameworks (React.js, TypeScript). Lead the front-end and back-end development efforts, ensuring seamless integration and responsive applicat...
decor
1 Day ago
Senior Software Engineer I - Java and ReactJS
Information Technology
  • Chennai, Tamil Nadu, India
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data a...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media