Information Technology
Full-Time
DATAECONOMY
Overview
About Us
About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.
Job Description
Job Title: PySpark Data Engineer
Experience: 5 – 8 Years
Location: Hyderabad
Employment Type: Full-Time
Job Summary
We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 5–8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache Airflow, with strong proficiency in SQL. You will be responsible for building scalable data processing solutions, optimizing data workflows, and collaborating with cross-functional teams to deliver high-quality data assets.
Key Responsibilities
Company standard benefits.
About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.
Job Description
Job Title: PySpark Data Engineer
Experience: 5 – 8 Years
Location: Hyderabad
Employment Type: Full-Time
Job Summary
We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 5–8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache Airflow, with strong proficiency in SQL. You will be responsible for building scalable data processing solutions, optimizing data workflows, and collaborating with cross-functional teams to deliver high-quality data assets.
Key Responsibilities
- Design, develop, and maintain large-scale ETL pipelines using PySpark and AWS Glue.
- Orchestrate and schedule data workflows using Apache Airflow.
- Optimize data processing jobs for performance and cost-efficiency.
- Work with large datasets from various sources, ensuring data quality and consistency.
- Collaborate with Data Scientists, Analysts, and other Engineers to understand data requirements and deliver solutions.
- Write efficient, reusable, and well-documented code following best practices.
- Monitor data pipeline health and performance; resolve data-related issues proactively.
- Participate in code reviews, architecture discussions, and performance tuning.
- 5–8 years of experience in data engineering roles.
- Strong expertise in PySpark for distributed data processing.
- Hands-on experience with AWS Glue and other AWS data services (S3, Athena, Lambda, etc.).
- Experience with Apache Airflow for workflow orchestration.
- Strong proficiency in SQL for data extraction, transformation, and analysis.
- Familiarity with data modeling concepts and data lake/data warehouse architectures.
- Experience with version control systems (e.g., Git) and CI/CD processes.
- Ability to write clean, scalable, and production-grade code.
Company standard benefits.
Similar Jobs
View All
1 Day ago
PHP Developer
Information Technology
- 3 - 7 Yrs
- Anywhere in India/Multiple Locations
We are looking for Senior PHP Developer, capable of developing high-end web applications using PHP ,MY SQL & CodeIgniter. Working knowledge in API Integrations for E-commerce portals preferred.
Required Candidate profile
3+ years Exp. with P...
1 Day ago
Java Developer
Information Technology
- 2 - 5 Yrs
- Anywhere in India/Multiple Locations
Role - Software Engineer (Java Developer)
Years of Experience - 2 to 5
Work Mode - Remote
Bachelors degree in computer science, Engineering, or a related field.
2 to 5 years of experience in Java development.
Proficiency in Java, with...
1 Day ago
Sr Engineer II (C++ Developer)
Information Technology
- Pune, Maharashtra, India
Seeking a highly motivated and self-driven Software Developer who will be responsible for developing slot content for Digital applications (Heart of Vegas, Cashman Casinos & Lightning Link) across various platforms (iOS, Android and Web).Quick Learn...
1 Day ago
Freelance UI Developer (Client Hire)
Information Technology
- Pune, Maharashtra, India
Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organisations seeking independent talent. Flexing It has partnered with ur client, a leading Procurement intelligence company which deals in...
1 Day ago
Network Engineer
Information Technology
- Pune, Maharashtra, India
OverviewRapiscan Systems is an industry leader in detection technology, providing cargo and vehicle inspection systems and services for ports, borders, military, high-threat facilities, and checkpoints to help customers combat terrorism, drug smuggl...
1 Day ago
Senior Software Engineer
Information Technology
- Pune, Maharashtra, India
OverviewWorking at AtlassianAtlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire ...
1 Day ago
Cloud Platform Engineer
Information Technology
- Pune, Maharashtra, India
Project Role : Cloud Platform EngineerProject Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof ...
1 Day ago
Application Developer
Information Technology
Project Role : Application DeveloperProject Role Description : Design, build and configure applications to meet business process and application requirements.Must have skills : React.jsGood to have skills : NAMinimum 7.5 Year(s) Of Experience Is Req...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in