Bangalore, Karnataka, India
Retail & E-commerce
Full-Time
krtrimaIQ Cognitive Solutions
Overview
We are looking for an immediate joiner and experienced Big Data Developer with a strong background in Kafka, PySpark, Python/Scala, Spark, SQL, and the Hadoop ecosystem. The ideal candidate should have over 5 years of experience and be ready to join immediately. This role requires hands-on expertise in big data technologies and the ability to design and implement robust data processing solutions.
Responsibilities
Responsibilities
- Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.
- Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related technologies.
- Write efficient SQL queries for data extraction, transformation, and analysis.
- Implement and manage Kafka streams for real-time data processing.
- Utilize scheduling tools to automate data workflows and processes.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Ensure data quality and integrity by implementing robust data validation processes.
- Optimize existing data processes for performance and scalability.
- Experience with GCP.
- Knowledge of data warehousing concepts and best practices.
- Familiarity with machine learning and data analysis tools.
- Understanding of data governance and compliance standards.
Similar Jobs
View All
1 Day ago
Junior/Senior Network Engineer – Network Operations Center (NOC) in Lucknow, Meerut, Kochi, Sohna, Mohali
Retail & E-commerce
- Bangalore, Karnataka, India
Key Responsibilities Monitor network devices and links using NMS tools to ensure availability and performance as per SLA. Identify and escalate faults or alarms for timely resolution Perform first-level diagnostics and assist in basic configurati...
1 Day ago
PHP Developer
Information Technology
- 500000 - 700000 Indian Rupee - Yearly
- Pune, Maharashtra, India
2-3 yrs of experience PHP web frameworks {such as Laravel, Yii, Angular, React, Node.JS etc depending on your technology stack}. Understanding the fully synchronous behavior of PHP. Understanding of MVC design patterns. Basic understanding of front...
1 Day ago
Junior/Senior Network Engineer – Network Operations Center (NOC) in Lucknow, Meerut, Kochi, Sohna, Mohali
Retail & E-commerce
- Bangalore, Karnataka, India
Key Responsibilities Monitor network devices and links using NMS tools to ensure availability and performance as per SLA. Identify and escalate faults or alarms for timely resolution Perform first-level diagnostics and assist in basic configurati...
1 Day ago
Junior/Senior Network Engineer – Network Operations Center (NOC) in Lucknow, Meerut, Kochi, Sohna, Mohali
Retail & E-commerce
- Bangalore, Karnataka, India
Key Responsibilities Monitor network devices and links using NMS tools to ensure availability and performance as per SLA. Identify and escalate faults or alarms for timely resolution Perform first-level diagnostics and assist in basic configurati...
1 Day ago
QA Engineer - .Net Platform
Information Technology
- 1000000 - 1400000 Indian Rupee - Yearly
- Pune, Maharashtra, India
Overview We are looking for a skilled QA Engineer with a robust focus on .NET technologies and experience in integrating Microsoft Power Platform into testing processes. This role demands a deep understanding of .NET-based applications, automated t...
1 Day ago
Associate Data Scientist in Gurgaon, Jaipur
Retail & E-commerce
- Bangalore, Karnataka, India
Key Responsibilities Utilize data analysis tools and software to extract meaningful insights from raw data. Collaborate with data engineers to design and implement databases, data collection systems, and analytical frameworks for optimized statist...
1 Day ago
Release / DevOps Engineer
Information Technology
- Pune, Maharashtra, India
About The RoleGrade Level (for internal use):09Role: Release / DevOps EngineerS&P Global Market Intelligence, a premier sector-focused news and financial information provider, is looking for a DevOps / Release Engineer to join the Release Services t...
1 Day ago
Senior Data Analyst
Information Technology
- Pune, Maharashtra, India
Job Title: Senior Data AnalystCareer Level - D1Introduction to roleYou will be responsible for providing analytical expertise to the Commercial Organization, driving strategic and operational excellence. This is a hands-on analytical role and as a p...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in