Chennai, Tamil Nadu, India
Information Technology
Full-Time
Prescience Decision Solutions
Overview
- Collaborate with business stakeholders and other technical team members to acquire and migrate data sources that are most relevant to business needs and goals.
- Demonstrate deep technical and domain knowledge of relational and non-relational databases, Data Warehouses, Data lakes, among other structured and unstructured storage options.
- Determine solutions that are best suited to develop a pipeline for a particular data source.
- Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development.
- Write custom scripts to extract data from unstructured / semi-structured sources.
- Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders.
- Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability).
- Stay current with and adopt new tools and applications to ensure high quality and efficient solutions.
- Build a cross-platform data strategy to aggregate multiple sources and process development datasets.
- Proven work experience as a Data Engineer or a similar role, focusing on data pipeline development, API integration, database design, and data management.
- Strong expertise in Azure cloud services, particularly Azure Data Factory (ADF), Azure SQL Database, Azure Blob Storage, Azure Data-bricks.
- Proficient in SQL and Python programming and experience working with relational databases, data warehousing, and data modelling concepts.
- Experience with API integration, including RESTful APIs, data extraction, and data ingestion from external systems.
- Solid understanding of ETL processes, data integration, and data transformation techniques.
- Proficiency in Python programming and experience with data manipulation, automation, and scripting tasks.
- Strong problem-solving and analytical skills, with the ability to identify and resolve complex data related issues
- Competitive salary and performance-based bonuses.
- Comprehensive insurance plans.
- Collaborative and supportive work environment.
- Chance to learn and grow with a talented team.
- A positive and fun work environment.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in