Overview
Company OverviewPredigle is a dynamic analytics solutions provider specializing in transforming raw data into actionable insights for businesses across the e-commerce and retail sectors. We empower our clients to optimize their operations, enhance customer experiences, and drive revenue growth through cutting-edge data engineering and analytics solutions. Our reach extends to supporting major players in the Indian e-commerce landscape.
Role Overview
As a Data Engineer at Predigle, you will be instrumental in building and maintaining the data infrastructure that powers our analytics solutions. You will collaborate closely with data scientists, analysts, and software engineers to design, develop, and deploy robust data pipelines, ensuring data quality, reliability, and scalability. Your work will directly impact our ability to deliver timely and accurate insights to our clients, enabling them to make data-driven decisions and achieve their business objectives.
Key Responsibilities
- Design and implement scalable and reliable data pipelines to ingest, process, and transform large volumes of data from various sources for analytics purposes.
- Develop and maintain data models and schemas to ensure data consistency and integrity across different systems.
- Optimize data storage and retrieval processes to improve query performance and reduce data processing time for data scientists and analysts.
- Monitor data pipeline performance and troubleshoot issues to ensure data availability and accuracy for critical business applications.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications for data engineering solutions.
- Implement data quality checks and validation procedures to identify and resolve data inconsistencies and errors, ensuring reliable insights for our clients.
- Automate data engineering tasks and processes to improve efficiency and reduce manual effort for the data engineering team.
- Demonstrated ability to design, develop, and maintain data pipelines using Python and related libraries (e.g., Pandas, NumPy, PySpark).
- Proven expertise in working with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
- Strong understanding of data warehousing concepts and experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
- Ability to effectively communicate technical concepts to both technical and non-technical audiences.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Ability to work effectively in a collaborative, on-site environment in Chennai.
- 5-8 years of relevant experience in data engineering.
(ref:hirist.tech)