Free cookie consent management tool by TermsFeed Data Engineer - Python/PySpark | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer - Python/PySpark

decor
Panchkula, Haryana, India
Information Technology
Full-Time
ScaleOrange Technologies Pvt Ltd

Overview

Job Description

We are seeking an experienced Data Engineer to join our team on a contractual basis for 3 months (extendable). The ideal candidate will have 4+ years of hands-on experience in data engineering, with advanced proficiency in SQL, and 3+ years of experience with Python and PySpark. This role requires flexibility to work in the 1 PM to 10 PM (timezone) shift.

Responsibilities

  • Data Integration and ETL : Develop, maintain, and optimize data pipelines and ETL processes to ensure efficient data processing and integration from multiple sources.
  • Advanced SQL : Design, query, and optimize complex SQL queries to extract, transform, and load (ETL) data efficiently. Proficient in writing optimized queries for large datasets and ensuring high performance.
  • Python and PySpark : Utilize Python for data manipulation, cleaning, and processing. Work extensively with PySpark to handle large-scale data processing and distributed computing tasks.
  • Data Modeling and Warehousing : Assist in designing, building, and maintaining data models and data warehouses, ensuring data integrity and performance.
  • Collaboration : Work closely with data scientists, analysts, and other engineers to understand data needs and optimize data workflows.
  • Troubleshooting and Optimization : Diagnose, troubleshoot, and resolve data-related issues and performance bottlenecks.
  • Documentation : Create and maintain documentation for data pipelines, processes, and data :
  • 4+ years of experience in data engineering or a related field.
  • Advanced SQL knowledge with experience in writing optimized queries for large databases.
  • 3+ years of experience in Python for data processing and automation.
  • 3+ years of hands-on experience with PySpark for distributed data processing.
  • Strong understanding of data modeling and database management.
  • Familiarity with cloud platforms (AWS, GCP, or Azure) is a plus.
  • Good understanding of data pipelines, ETL tools, and big data ecosystems.
  • Ability to work in a collaborative, fast-paced environment.
  • Strong problem-solving and debugging skills.
  • Excellent communication skills and ability to work in a remote team.

(ref:hirist.tech)
Share job
Similar Jobs
View All
16 Hours ago
Data Analyst (Odia Speakers)
AI & Machine Learning Advancement
  • 1 - 20 Yrs
  • Jharkhand, Andhra Pradesh, Odisha
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
16 Hours ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
  • 1 - 20 Yrs
  • Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
18 Hours ago
Technical Lead - Backend Development - Node.Js
Finance & Banking
  • 50,00,000 - 55,00,000 INR - Annual
  • 6 - 8 Yrs
  • Bangalore
What youʼll be doing We are much more than our job descriptions, but here is where you will begin: ● Collaborate with stakeholders, including product owners, project managers, and scrum masters, to define and clarify project requirements. ● Transl...
decor
19 Hours ago
Engineering Manager
Finance & Banking
  • 55,00,000 - 60,00,000 INR - Annual
  • 8 - 12 Yrs
  • Bangalore
What youʼll be doing Weʼre much more than our job descriptions, but hereʼs where youʼll begin: ● Lead and deliver large-scale platform and product initiatives that impact millions of users. ● Collaborate with product, design, and business teams to...
decor
23 Hours ago
Technical Project Manager (WordPress)
Information Technology
  • 6 - 10 Yrs
  • Ahmedabad
Location: Ahmedabad / Remote Experience: 6+ Years About Us: E2M Solutions is home to a growing remote team of WordPress experts building innovative digital solutions. We pride ourselves on delivering consistent value and excellence to our client...
decor
1 Day ago
Senior WordPress Frontend Developer
Information Technology
  • 5 - 10 Yrs
  • Ahmedabad
At E2M Solutions, we're building a powerhouse remote team to deliver high-performing, user-centric WordPress solutions. If you live and breathe frontend development and are looking to work on cutting-edge WordPress projects with a passionate global t...
decor
1 Day ago
Python Developer - C++/EDA
Information Technology
  • Chennai, Tamil Nadu, India
Job DescriptionWe are seeking a highly skilled C++ Python Developer with a strong background in software development, scripting, and EDA tool integration. This role focuses on creating, enhancing, and maintaining tools used in silicon design and ver...
decor
1 Day ago
Business Analyst
Information Technology
  • Chennai, Tamil Nadu, India
Project Role : Business AnalystProject Role Description : Analyze an organization and design its processes and systems, assessing the business model and its integration with technology. Assess current state, identify customer requirements, and defin...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media