Noida, Uttar Pradesh, India
Space Exploration & Research, Information Technology
Full-Time
IBM
Overview
Introduction
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role And Responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform
Master's Degree
Required Technical And Professional Expertise
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role And Responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform
- Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS
- Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform
- Experience in developing streaming pipelines
- Experience to work with Hadoop / Azure eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc
Master's Degree
Required Technical And Professional Expertise
- Total 5-8 years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills
- Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala;
- Minimum 3 years of experience on Cloud Data Platforms on Azure;
- Experience in Data Bricks / Azure HDInsight / Azure Data Factory, Synapse, SQL Server DB
- Good to excellent SQL skills
- Certification in Azure and Data Bricks or Cloudera Spark Certified developers
- Experience in DataBricks / Azure HDInsight / Azure Data Factory, Synapse, SQL Server DB
- Knowledge or experience of Snowflake will be an added advantage
Similar Jobs
View All
1 Day ago
Chief Technology Officer (CTO)
Information Technology
- 9 - 15 Yrs
- Mumbai (All Areas)
Role & responsibilities
* Develop and execute the company's technology roadmap aligned with business goals.
* Lead and mentor the engineering and IT teams to ensure high performance.
* Identity and implement emerging technologies to enhance ...
2 Days ago
Website Developer
Information Technology
- 700000 - 1200000 INR - Annual
- 5 - 10 Yrs
- Udaipur
Job Title: Website Developer
Location: Udaipur, Rajasthan (HO)
Job Type: Full-time
Experience Level: Senior (5 TO 10 Years)
About the Role:
We are looking for a skilled and detail-oriented Website Developer to join our team. The ideal candidat...
2 Days ago
Business Analyst
Information Technology
- Delhi, Delhi, India
Job DescriptionBusiness Analyst, Sales Operations:As Gartner Conferences continues its rapid expansion, we are seeking a highly motivated and analytical Sales Operations Analyst to join our dynamic team. This pivotal role supports the operational ne...
2 Days ago
ChicMic Studios - Python/Django Developer
Information Technology
- Delhi, Delhi, India
Profile : Python developer.Experience : 2-6 Years.Location : Mohali, Punjab (WFO).ChicMic Studios is on the lookout for a skilled Python Developer who loves turning complex problems into elegant solutions.If you have a passion for Django, Flask, AWS...
2 Days ago
Sr Data Engineer
Information Technology
- Delhi, Delhi, India
Job DescriptionAbout HighspotHighspot is a software product development company and a recognized global leader in the sales enablement category, leveraging cutting-edge AI and GenAI technologies at the core of its robust Software-as-a-Service (SaaS)...
2 Days ago
ChicMic Studios - Angular Developer - TypeScript/Javascript
Information Technology
- Delhi, Delhi, India
Key Responsibilities Develop and maintain responsive, high-performance web applications using Angular. Collaborate with UX/UI designers and back-end developers to implement user-friendly features. Optimize application for maximum speed and scalab...
2 Days ago
Oracle PL-SQL Developer
Information Technology
- Delhi, Delhi, India
Role SummaryWe are seeking a skilled Oracle PL/SQL Developer to design, develop, optimize, and maintain PL/SQL code for a regulatory database application which integrates with middleware and external APIs of MHA and DOT. The ideal candidate will hav...
2 Days ago
Software Engineer Senior
Information Technology
- Delhi, Delhi, India
The CompanyGentrack provides leading utilities across the world with innovative cleantech solutions. The global pace of change is accelerating, and utilities need to rebuild for a more sustainable future. Working with some of the world’s biggest ene...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in