Hyderabad, Telangana, India
Information Technology
Full-Time
Agira Technologies
Overview
Role Overview
We are seeking a highly motivated and skilled Data Engineer to join our dynamic team.
In this role, you will be instrumental in building, optimizing, and maintaining our data infrastructure.
You will work closely with cross-functional teams to understand data requirements, develop efficient data pipelines, and ensure data quality and integrity.
The ideal candidate possesses a strong foundation in database programming, scripting, API integration, and data migration, along with excellent communication skills and the ability to thrive in a fast-paced environment.
Key Responsibilities
We are seeking a highly motivated and skilled Data Engineer to join our dynamic team.
In this role, you will be instrumental in building, optimizing, and maintaining our data infrastructure.
You will work closely with cross-functional teams to understand data requirements, develop efficient data pipelines, and ensure data quality and integrity.
The ideal candidate possesses a strong foundation in database programming, scripting, API integration, and data migration, along with excellent communication skills and the ability to thrive in a fast-paced environment.
Key Responsibilities
- Design, develop, and maintain robust data pipelines using PySpark and SparkSQL.
- Write efficient, reusable, and reliable code in Python.
- Perform data extraction, transformation, and loading (ETL) from various structured and unstructured data sources.
- Work with large-scale datasets and implement scalable data processing solutions.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver
- Optimize and troubleshoot performance issues in data pipelines and queries.
- Ensure data quality, integrity, and security across all pipelines.
- Strong hands-on experience in Python and PySpark.
- Proficient in SQL and SparkSQL.
- Solid understanding of distributed computing and big data processing frameworks (Apache Spark).
- Experience with cloud data platforms (AWS, Azure, or GCP) is a plus.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in