Free cookie consent management tool by TermsFeed Data Engineer-Data Platforms | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer-Data Platforms

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
IBM

Overview

Introduction

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your Role And Responsibilities

  • As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.

Your Primary Responsibilities Include

  • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
  • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
  • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

Preferred Education

Master's Degree

Required Technical And Professional Expertise

  • Must have 5+ years exp in Big Data -Hadoop Spark -Scala ,Python
  • Hbase, Hive Good to have Aws -S3,
  • athena ,Dynomo DB, Lambda, Jenkins GIT
  • Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations.

Preferred Technical And Professional Experience

  • Understanding of Devops.
  • Experience in building scalable end-to-end data ingestion and processing solutions
  • Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala
Share job
Similar Jobs
View All
7 Hours ago
Engineering Manager
Information Technology
  • 30 - 40 INR - Annual
  • 10 - 12 Yrs
  • Bangalore
We are hiring a hands-on Engineering Manager to lead our 100+ member engineering team across web, mobile, and backend (Shopify, Node.js, React.js, React Native). They will drive strategy, delivery, and team performance while working closely with the ...
decor
11 Hours ago
Dot Net Developer
Finance & Banking
  • 200000 - 300000 INR - Annual
  • 2 - 6 Yrs
  • Mumbai
Key Responsibilities:  Design, develop, and maintain WinForms applications.  Knowledge of .NET languages including C#, & Winforms is Mandatory.  Collaborate with cross-functional teams to define, design, and implement new features.  Write c...
decor
11 Hours ago
Data Analyst
Information Technology
  • 2 - 8 Yrs
  • Delhi / NCR, Mumbai, Bangalore, Chennai, Jaipur, Lucknow, Hyderabad, Pune
Job description Were hiring a Data Analyst to turn raw data into meaningful visualizations and reports. Location - Delhi / Pune / Mumbai / Jaipur / Chennai / Lucknow / Hyderabad / Banglore ( Remote / Hybrid ) Key Responsibilities: Analyze...
decor
1 Day ago
Fullstack Developer .Net
Information Technology
  • 1200000 - 1500000 INR - Annual
  • 2 - 3 Yrs
  • Chennai
Your Responsibilities: Develop responsive, modular front-end components using React, TypeScript/JSX, and the MUI library. Design and implement secure, scalable backend services with .NET 8 and C#. Optimize SQL queries and wor...
decor
1 Day ago
Business Analyst - Financial Services Domain
Information Technology
  • Bangalore, Karnataka, India
Job Title : Business AnalystReporting StructureThe role is part of Project Management VerticalJob DescriptionWe are seeking an experienced Business Analyst with 1-3 years of experience with a background in financial services and in handling regulat...
decor
1 Day ago
Data Engineer Job
Information Technology
  • Pune, Maharashtra, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
decor
1 Day ago
Software Engineer, Cyber Security Embedded
Information Technology
  • Pune, Maharashtra, India
The Impact You'll MakeDanfoss Power Solutions designs and manufactures a complete range of engineered components and systems. From hydraulics and electrification to fluid conveyance, electronic controls, and software, our solutions are engineered wi...
decor
1 Day ago
Business Analyst
Information Technology
  • Bangalore, Karnataka, India
Lead process discovery and analysis of the current-state RFI process across compliance, business, and operational teams. Design an optimized future-state RFI process, aligned with regulatory expectations, internal risk appetite, and digital bank o...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media