Data Engineer – AWS Glue, Redshift,, PySpark

Company Overview:

Cyepro Solutions is at the forefront of innovation in customer relationship management, specializing in the automotive industry. We offer a platform that empowers dealerships, manufacturers, and service providers to enhance customer experiences and streamline operations. Headquartered in Hyderabad, Telangana, with a team of 51-200 employees, Cyepro Solutions is dedicated to transforming automotive CRM and delivering sustainable growth solutions.

Job Overview:

We are seeking a talented Data Engineer to join our team at Cyepro Solutions. Located in Hyderabad, this mid-level position is a full-time role that focuses on leveraging cutting-edge technologies to transform data operations and contribute to our CRM solutions. The successful candidate will work in a dynamic environment with opportunities to impact our company's future success.

Qualifications and Skills:

• AWS Glue (Mandatory skill) - Extensive experience in using AWS Glue for data integration and ETL processes.
• PySpark (Mandatory skill) - Proficient in developing data processing frameworks and workflows using PySpark.
• Redshift (Mandatory skill) - In-depth knowledge and experience in optimizing and managing Amazon Redshift clusters.
• Python - Strong programming skills in Python for data manipulation and analysis.
• ETL - Experience with Extract, Transform, Load (ETL) processes in large-scale data environments.
• Strong analytical and troubleshooting skills for resolving data processing issues effectively.
• Ability to work collaboratively in a team and communicate effectively with technical and non-technical stakeholders.
• Familiarity with data modeling and database design concepts, ensuring the reliability and efficiency of data systems.

Roles and Responsibilities:

• Design, develop, and maintain scalable ETL processes using AWS Glue and PySpark.
• Optimize Redshift clusters for performance, ensuring data accuracy and efficiency in processing.
• Collaborate with cross-functional teams to understand data needs and deliver appropriate data solutions.
• Develop and automate data pipelines to support data analytics and business intelligence efforts.
• Monitor and troubleshoot data workflow issues to ensure data reliability and availability.
• Participate in code reviews and provide constructive feedback to maintain code quality standards.
• Document data processes and pipelines to facilitate knowledge sharing and stakeholder understanding.
• Stay updated with the latest industry trends and best practices in data engineering and AWS services.