Free cookie consent management tool by TermsFeed Data Engineer II | Antal Tech Jobs
Back to Jobs
3 Days ago

Data Engineer II

decor
Pune, Maharashtra, India
Information Technology
Full-Time
IDFC FIRST Bank

Overview

Job Requirements

Role/ Job Title: Data Engineer 2

Function/ Department: Data & Analytics

Job Purpose

The Data Engineer is responsible for developing day to day data engineering projects and aiding in building the business’ data collection systems and processing pipelines.

Responsible for efficient code for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.

He/She works with Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau, Python, and Spark.

The Data Engineer strives to continuously develop most efficient code for data pipeline or use case needs.

Roles & Responsibilities

  • Minimum 1-2 years of Data Engineering experience
  • Proven experience in in SQL, Spark, Hadoop ecosystem
  • Have worked on multiple Tabs of data volume from ingestion to consumption.
  • Work with business stakeholders to identify and document high impact business problems and potential solutions.
  • Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (Cloudera, Hortonworks) and/or AWS
  • Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API and its usability.
  • A suitable candidate will also be proficient in Spark, Spark Streaming, hive, SQLs A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.
  • The candidate will additionally demonstrate substantial experience and a deep knowledge of relational databases.
  • Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning
  • Creating Technical Design Documentation of the projects/pipelines

Secondary Responsibility

  • Ability to work independently and handle your own development effort.
  • Excellent oral and written communication skills Learn and use internally available analytic technologies.
  • Identify key performance indicators and create educational/deliverables path to achieve the same.
  • Use educational background in data engineering and perform data mining analysis.
  • Work with BI analysts/engineers to create prototypes.
  • Engage in the delivery and presentation of solutions.

Education Qualification

Graduation: Bachelor of Science (B.Sc) / Bachelor of Technology (B.Tech) / Bachelor of Computer Applications (BCA)

Post-Graduation: Master of Science (M.Sc) /Master of Technology (M.Tech) / Master of Computer Applications (MCA)

Experience: 2 to 6 years of relevant experience.
Share job
Similar Jobs
View All
5 Hours ago
Devops Cloud Engineer
Information Technology
  • 3000000 - 3500000 INR - Monthly
  • 7 - 14 Yrs
  • Mumbai
Minimum Experience/Training Required: • At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment • Proven ability to work across structured, semi-structured, and unstructured d...
decor
1 Day ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
1 Day ago
Cybersecurity Engineer
Information Technology
  • 2 - 8 Yrs
  • Anywhere in India/Multiple Locations
Key Responsibilities: Design, implement, and manage Palo Alto Networks solutions, including: Next-Gen Firewall (NGFW) EDR/XDR (Cortex XDR) SIEM/SOAR (Cortex XSIAM) Lead and support migration projects from legacy platforms (e.g., Splunk,...
decor
1 Day ago
Application Developer
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Project Role :Application Developer Must have skills :.Net Full Stack Development Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processe...
decor
1 Day ago
Rosmerta Technologies - Software Java Developer - Spring Boot Framework
Information Technology
  • Pune, Maharashtra, India
Job SummaryWe are seeking a highly experienced and skilled Software Java Developer with a minimum of 8 years of experience to join our dynamic engineering team.The ideal candidate will be a seasoned professional with a strong foundation in Java back...
decor
1 Day ago
Machine Learning Engineer - NLP/Generative AI
Information Technology
  • Pune, Maharashtra, India
About UsWe are a UK-based conveyancing firm dedicated to transforming property transactions through cutting-edge artificial intelligence. We are seeking a talented Machine Learning Engineer with 12 years of experience to join our growing AI team. Th...
decor
1 Day ago
Lead Software Engineer-R-248730
Information Technology
  • Pune, Maharashtra, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
1 Day ago
Software Engineer - Java Full Stack Developer
Information Technology
  • Pune, Maharashtra, India
Job DescriptionAre you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovati...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media