Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
The Citco Group Limited

Overview

Job Description

  • Analysis, design, development, support and maintenance of DW, Data Lake and Lakehouse infrastructures
  • Technical expertise on data pipelines and ETL processes.
  • Solid understanding of SQL and Data Modelling
  • Hands on experience with Databricks on AWS cloud solutions
  • In-depth knowledge of Databricks ETL and Orchestration, notebook development and job scheduling
  • Collaborate with cross-functional teams of business analysts, business users and IT stakeholders gathering, documenting, analysing and implementing requirement
  • Collaborate with multiple teams to develop and maintain data pipelines, harvesting data from systems of records to create data products
  • Create and optimize relational databases schema, tables, indexes, views, and stored procedures

Responsibilities

  • Perform data migration, transformation, and integration tasks between different database systems
  • Develop and maintain ETL processes to load and transform data from various sources
  • Work with other development groups to advise, guide and assist in their integrations
  • Familiarity with version control systems (e.g. GIT) and Agile development methodologies
  • Interact with vendor for support and consultancy
  • Work directly with reporting manager to ensure clear and accurate communication of current status, dependencies and estimated delivery timelines
  • Clearly communicate issues, risks and proposed solutions to relevant stakeholders
  • Coordinate the release process with business groups, operations in compliance with ITIL Change Management discipline
  • Communicate detailed descriptions of functionality changes and provide follow up support as required
  • Support QA testing
  • Provide direction & support to the Business Divisions for User Acceptance Testing
  • Utilizing Reporting tools to rapidly create, modify, refresh and update dashboards and reports

Qualifications

  • Experience with business intelligence, data analysis, data modelling and visualization solutions on Cloud, on-premises and hybrid
  • experience in Databricks on Amazon Web Services cloud computing platforms
  • Experience with Databricks platform
  • Experience with Python, SQL, relational database objects (Oracle and/or SQL Server) and procedural languages (PL/SQL and/or T-SQL)
  • Experience with Version Control systems
  • Web Services integration using REST/SOAP/JSON
Share job
Similar Jobs
View All
22 Hours ago
Program Manager
Information Technology
  • 15 - 18 Yrs
  • Gurgaon / Gurugram
We’re Hiring | Program Manager Location: Gurugram, India Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
decor
23 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
  • 50,00,000 - 60,00,000 INR - Annual
  • 12 - 18 Yrs
  • Hyderabad
About the Role: We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
decor
23 Hours ago
Principal Engineer - Fullstack
Information Technology
  • 30,00,000 - 40,00,000 INR - Annual
  • 8 - 12 Yrs
  • Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
decor
23 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
  • 4,00,000 - 8,00,000 INR - Yearly
  • 4 - 8 Yrs
  • West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
decor
1 Day ago
Axis My India - Data Analyst - Python/Pandas
Pharmaceuticals
  • Hyderabad, Telangana, India
About The CompanyAxis My India is Indias foremost Consumer Data Intelligence Company, which in partnership with Google is building a single-stop People Empowerment Platform, the a app, that aims to change peoples awareness, accessibility, and utiliz...
decor
1 Day ago
Data Engineer
Pharmaceuticals
  • Hyderabad, Telangana, India
Job Title - Data EngineerAbout TazapayTazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anyw...
decor
1 Day ago
Master Data Analyst – Application Support
Pharmaceuticals
  • Hyderabad, Telangana, India
About Inchcape Shipping ServicesAt Inchcape, our vision is to have a connected world, in which our customers trade successfully and make better decisions in every port, everywhere. We use technology and our global network to help our partners connec...
decor
1 Day ago
Angular Developer
Pharmaceuticals
  • Hyderabad, Telangana, India
Who We AreApplied Materials is the global leader in materials engineering solutions used to produce virtually every new chip and advanced display in the world. We design, build and service cutting-edge equipment that helps our customers manufacture ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media