Free cookie consent management tool by TermsFeed Lead Data Engineer | Antal Tech Jobs
Back to Jobs
5 Days ago

Lead Data Engineer

decor
Pune, Maharashtra, India
Information Technology
Full-Time
Eucloid Data Solutions

Overview

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components. Candidate will also be involved in projects like integrating data from various sources, managing big data pipelines that are easily accessible with optimized performance of the overall ecosystem. The ideal candidate is an experienced data wrangler who will support our software developers, database architects, and data analysts on business initiatives. You must be self-directed and comfortable supporting the data needs of cross-functional teams, systems, and technical solutions.

Responsibilities

  • Design, implementation, and improvement of processes and automation of the Data infrastructure.
  • Tuning of Data pipelines for reliability and performance.
  • Building tools and scripts to develop, monitor, and troubleshoot ETLs.
  • Perform scalability, latency, and availability tests on a regular basis.
  • Perform code reviews and QA data imported by various processes.
  • Investigate, analyze, correct, and document reported data defects.
  • Create and maintain technical specification documentation.

Requirements

  • B. Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines.
  • Min. 4 years of Professional work experience as a data engineer.
  • Highly proficient in SQL and Data model (conceptual and logical) concepts.
  • Highly proficient with Python and Spark.
  • Knowledge of distributed computing and cloud databases like Redshift, BigQuery, etc.
  • 4+ years of Hands-on experience with AWS/ GCP.
  • Experience with Modern Data stack tools like Airflow, Terraform, dbt, Glue, Dataproc, etc.
  • Exposure to Hadoop and Shell scripting is a plus.

This job was posted by Eucloid Careers from Eucloid Data Solutions.
Share job
Similar Jobs
View All
1 Day ago
Senior Software Engineer - Java Technologies
Information Technology
  • Hyderabad, Telangana, India
Year of experience : 4 - 6 yrsJob Location : PuneSummaryThe Programmer will participate in the design and development of a multi-user, multi-tenant, analytics centric application using Java EE/State-of-the-art technologies.Major Responsibilities An...
decor
1 Day ago
DevOps Engineer
Information Technology
  • Hyderabad, Telangana, India
Job DescriptionJob SummaryWe are seeking a skilled and motivated Azure DevOps Engineer to join our team. The ideal candidate will have experience designing and implementing DevOps practices using Microsoft Azure, including CI/CD pipelines, infrastru...
decor
1 Day ago
Business Analyst
Information Technology
  • Hyderabad, Telangana, India
Project Role : Business AnalystProject Role Description : Analyze an organization and design its processes and systems, assessing the business model and its integration with technology. Assess current state, identify customer requirements, and defin...
decor
1 Day ago
Senior Application Developer - IBM ODM
Information Technology
  • Hyderabad, Telangana, India
Job DescriptionBefore you apply to a job, select your language preference from the options available at the top right of this page.Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our ...
decor
1 Day ago
Data Analyst 2
Information Technology
  • Hyderabad, Telangana, India
Job DescriptionComcast brings together the best in media and technology. We drive innovation to create the worlds best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesse...
decor
1 Day ago
Snowflake Data Engineer - Python/PySpark
Information Technology
  • Hyderabad, Telangana, India
Job SummaryWe are seeking a highly skilled and hands-on Snowflake Data Engineer to join our data engineering team.This role requires a deep understanding of Snowflake's core components including Snowpipe, Streams, and Tasks, as well as strong experi...
decor
1 Day ago
Business Analyst in Gurgaon
Information Technology
  • Hyderabad, Telangana, India
Benepik is looking for a talented Business Analyst to join our dynamic team! In this role, you will utilize your expertise in SQL, Business Analysis, Wireframing, User Stories, Business Research, and Test Case Design to drive business growth and inn...
decor
1 Day ago
Big Data Engineer - Spark/Scala
Information Technology
  • Hyderabad, Telangana, India
Spark Scala DeveloperLocation : Bengaluru, MumbaiEmployment Type : Full-timeWhat Were Looking ForWere hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know ho...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media