Free cookie consent management tool by TermsFeed Lead Data Engineer (Remote) | Antal Tech Jobs
Back to Jobs
4 Days ago

Lead Data Engineer (Remote)

decor
Information Technology
Full-Time
Go Digital Technology Consulting LLP

Overview

Designation – Data Engineer (Engineer & Senior Engineer Level)

Location: Remote (across India)

Experience: 3 to 8 years

Technologies / Skills

  • Strong hands-on experience with AWS data engineering services (ETL, orchestration, and streaming tools.
  • Proficiency in SQL, Python (Pandas, NumPy) and PySpark.
  • Experience in ETL/ELT pipeline development, data modeling and working with large-scale data systems.
  • Familiarity with CI/CD workflows, Git and version control practices.

Responsibilities

  • Collaborate with business stakeholders and technical teams to gather requirements and translate them into scalable data solutions.
  • Design, build and maintain robust, secure, high-performance data pipelines
  • Ensure adherence to data quality, governance and compliance standards
  • Work with architects and engineering leads to follow best practices and optimize for performance
  • Communicate insights and technical decisions effectively with cross-functional stakeholders
  • Participate in Agile ceremonies and deliver iterative improvements in data infrastructure

Required Qualifications

  • 3+ years of hands-on experience with AWS data engineering services, including:
  • AWS Glue, Athena, EMR, Redshift, Lambda, Kinesis, S3, Step Functions, CloudWatch.
  • Expertise in building data pipelines using PySpark/Spark SQL.
  • Strong SQL and Python skills with experience in large-scale data transformation and ingestion.
  • Knowledge of Spark internals (joins, partitioning, memory management) and performance tuning via Spark UI.
  • Experience with Git, CI/CD pipelines, and working in Agile environments.
  • Understanding of partitioning, schema design, and query performance optimization.

Desired Qualifications

  • Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions.
  • Exposure to streaming platforms such as Kafka, Kinesis etc .
  • Working knowledge of AWS SDKs (e.g., Boto3) for automation and integration.
  • Familiarity with modern ETL/ELT patterns and data modeling techniques.
  • Basic proficiency in shell scripting for automation and support tasks.
Share job
Similar Jobs
View All
1 Day ago
PHP Developer
Information Technology
  • 3 - 7 Yrs
  • Anywhere in India/Multiple Locations
We are looking for Senior PHP Developer, capable of developing high-end web applications using PHP ,MY SQL & CodeIgniter. Working knowledge in API Integrations for E-commerce portals preferred.   Required Candidate profile 3+ years Exp. with P...
decor
1 Day ago
Java Developer
Information Technology
  • 2 - 5 Yrs
  • Anywhere in India/Multiple Locations
Role - Software Engineer (Java Developer) Years of Experience - 2 to 5 Work Mode - Remote Bachelors degree in computer science, Engineering, or a related field. 2 to 5 years of experience in Java development. Proficiency in Java, with...
decor
1 Day ago
Sr Engineer II (C++ Developer)
Information Technology
  • Pune, Maharashtra, India
Seeking a highly motivated and self-driven Software Developer who will be responsible for developing slot content for Digital applications (Heart of Vegas, Cashman Casinos & Lightning Link) across various platforms (iOS, Android and Web).Quick Learn...
decor
1 Day ago
Freelance UI Developer (Client Hire)
Information Technology
  • Pune, Maharashtra, India
Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organisations seeking independent talent. Flexing It has partnered with ur client, a leading Procurement intelligence company which deals in...
decor
1 Day ago
Network Engineer
Information Technology
  • Pune, Maharashtra, India
OverviewRapiscan Systems is an industry leader in detection technology, providing cargo and vehicle inspection systems and services for ports, borders, military, high-threat facilities, and checkpoints to help customers combat terrorism, drug smuggl...
decor
1 Day ago
Senior Software Engineer
Information Technology
  • Pune, Maharashtra, India
OverviewWorking at AtlassianAtlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire ...
decor
1 Day ago
Cloud Platform Engineer
Information Technology
  • Pune, Maharashtra, India
Project Role : Cloud Platform EngineerProject Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof ...
decor
1 Day ago
Application Developer
Information Technology
Project Role : Application DeveloperProject Role Description : Design, build and configure applications to meet business process and application requirements.Must have skills : React.jsGood to have skills : NAMinimum 7.5 Year(s) Of Experience Is Req...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media