Surat, Gujarat, India
Information Technology
Full-Time
IBM
Overview
Introduction
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role And Responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform
Master's Degree
Required Technical And Professional Expertise
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role And Responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform
- Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS
- Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform
- Experience in developing streaming pipelines
- Experience to work with Hadoop / Azure eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc
Master's Degree
Required Technical And Professional Expertise
- Total 5-8 years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills
- Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala;
- Minimum 3 years of experience on Cloud Data Platforms on Azure;
- Experience in Data Bricks / Azure HDInsight / Azure Data Factory, Synapse, SQL Server DB
- Good to excellent SQL skills
- Certification in Azure and Data Bricks or Cloudera Spark Certified developers
- Experience in DataBricks / Azure HDInsight / Azure Data Factory, Synapse, SQL Server DB
- Knowledge or experience of Snowflake will be an added advantage
Similar Jobs
View All
20 Hours ago
Data Analyst
Information Technology
- 300000 - 1200000 INR - Annual
- 1 - 7 Yrs
- Anywhere in India/Multiple Locations
Location: Remote – India
Experience: 1–7 years
Employment Type: Full-time & Part-time options available
About the Role
We’re seeking analytical minds who love turning data into actionable insights. As a Data Analyst, you’ll work closely w...
21 Hours ago
Sr. ServiceNow Developer | 8+ Years | Pune
Information Technology
- 30 - 40 INR - Annual
- 8 - 11 Yrs
- Pune
About the Role:
This is a senior-level ServiceNow Developer role where you’ll be responsible for driving the technical vision and execution of complex ServiceNow solutions across the organization.
What We’re Looking For:
Strong hands-...
21 Hours ago
Mobile Developer
Information Technology
- 350000 - 1000000 INR - Annual
- 1 - 6 Yrs
- Anywhere in India/Multiple Locations
About the Role
We're looking for talented Mobile Developers—whether you're a rising star with a year of experience or a seasoned engineer with eight—to build intuitive, high-performance mobile applications for Android and iOS. You’ll collaborate w...
2 Days ago
IT Support Executive
Information Technology
- Hyderabad, Telangana, India
hackajob is collaborating with British Airways to connect them with exceptional tech professionals for this role.A career without limitsAs the nation’s flag carrier, we take great pride in connecting Britain with the world and the world with Britain...
2 Days ago
Full Stack Developer (Java + AWS DevOps Focus)
Information Technology
- Hyderabad, Telangana, India
Company Description We are a Stealth GenAI B2B Startup focused on revolutionizing construction industry using Artificial General Intelligence. Our team is comprised of visionaries, researchers, and engineers dedicated to pushing the boundaries of AI...
2 Days ago
DevOps Engineer
Information Technology
- Surat, Gujarat, India
About QuantaniteQuantanite is a customer experience (CX) solutions company that helps fast-growing companies and leading global brands to transform and grow. We do this through a collaborative and consultative approach, rethinking business processes...
2 Days ago
Tech Carrot - Data Engineer - Python/ETL
Information Technology
- Hyderabad, Telangana, India
Skills Advanced working knowledge and experience with relational and non-relational databases. Experience building and optimizing Big Data pipelines, architectures, and datasets. Strong analytic skills related to working with structured and unstr...
2 Days ago
Software Engineer - Java8 & React Fullstack_C2E
Information Technology
- Surat, Gujarat, India
Reference 250008EIResponsibilitiesJob description:As a full stack developer, you’ll will work in agile. You will participate to all the agile ceremonies (sprint planning, refinement, retrospective, poker planning et sprint review)As part of the Pari...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in