Free cookie consent management tool by TermsFeed Data Engineer /Senior Data Engineer | Antal Tech Jobs
Back to Jobs
6 Days ago

Data Engineer /Senior Data Engineer

decor
Chennai, Tamil Nadu, India
Information Technology
Full-Time
Prescience Decision Solutions

Overview

  • Collaborate with business stakeholders and other technical team members to acquire and migrate data sources that are most relevant to business needs and goals.
  • Demonstrate deep technical and domain knowledge of relational and non-relational databases, Data Warehouses, Data lakes, among other structured and unstructured storage options.
  • Determine solutions that are best suited to develop a pipeline for a particular data source.
  • Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development.
  • Write custom scripts to extract data from unstructured / semi-structured sources.
  • Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders.
  • Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability).
  • Stay current with and adopt new tools and applications to ensure high quality and efficient solutions.

Requirements

  • Build a cross-platform data strategy to aggregate multiple sources and process development datasets.
  • Proven work experience as a Data Engineer or a similar role, focusing on data pipeline development, API integration, database design, and data management.
  • Strong expertise in Azure cloud services, particularly Azure Data Factory (ADF), Azure SQL Database, Azure Blob Storage, Azure Data-bricks.
  • Proficient in SQL and Python programming and experience working with relational databases, data warehousing, and data modelling concepts.
  • Experience with API integration, including RESTful APIs, data extraction, and data ingestion from external systems.
  • Solid understanding of ETL processes, data integration, and data transformation techniques.
  • Proficiency in Python programming and experience with data manipulation, automation, and scripting tasks.
  • Strong problem-solving and analytical skills, with the ability to identify and resolve complex data related issues

Benefits

  • Competitive salary and performance-based bonuses.
  • Comprehensive insurance plans.
  • Collaborative and supportive work environment.
  • Chance to learn and grow with a talented team.
  • A positive and fun work environment.
Share job
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
decor
1 Day ago
Salesforce commerce cloud consultant
Information Technology
  • Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant  5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
decor
1 Day ago
Cloud Infrastructure Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
decor
1 Day ago
Devops Engineer- Intermetiate
Information Technology
  • Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
decor
1 Day ago
Sr Data Scientist (London)
Information Technology
  • Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
decor
1 Day ago
Software Test Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
decor
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
  • Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
decor
1 Day ago
Java Developer - Spring Frameworks
Information Technology
  • Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media