Bangalore, Karnataka, India
Information Technology
Full-Time
Citi
Overview
Responsible for designing, developing, and optimizing data processing solutions using a combination of Big Data technologies. Focus on building scalable and efficient data pipelines for handling large datasets and enabling batch & real-time data streaming and processing.
Responsibilities:
Responsibilities:
- > Develop Spark applications using Scala or Python (Pyspark) for data transformation, aggregation, and analysis.
> Develop and maintain Kafka-based data pipelines: This includes designing Kafka Streams, setting up Kafka Clusters, and ensuring efficient data flow.
> Create and optimize Spark applications using Scala and PySpark: They leverage these languages to process large datasets and implement data transformations and aggregations.
> Integrate Kafka with Spark for real-time processing: They build systems that ingest real-time data from Kafka and process it using Spark Streaming or Structured Streaming.
> Collaborate with data teams: This includes data engineers, data scientists, and DevOps, to design and implement data solutions.
> Tune and optimize Spark and Kafka clusters: Ensuring high performance, scalability, and efficiency of data processing workflows.
> Write clean, functional, and optimized code: Adhering to coding standards and best practices.
> Troubleshoot and resolve issues: Identifying and addressing any problems related to Kafka and Spark applications.
> Maintain documentation: Creating and maintaining documentation for Kafka configurations, Spark jobs, and other processes.
> Stay updated on technology trends: Continuously learning and applying new advancements in functional programming, big data, and related technologies.
Proficiency in:
Hadoop ecosystem big data tech stack(HDFS, YARN, MapReduce, Hive, Impala).
Spark (Scala, Python) for data processing and analysis.
Kafka for real-time data ingestion and processing.
ETL processes and data ingestion tools
Deep hands-on expertise in Pyspark, Scala, Kafka
Programming Languages:
Scala, Python, or Java for developing Spark applications.
SQL for data querying and analysis.
Other Skills:
Data warehousing concepts.
Linux/Unix operating systems.
Problem-solving and analytical skills.
Version control systems
------------------------------------------------------
Job Family Group:
Technology
------------------------------------------------------
Job Family:
Applications Development
------------------------------------------------------
Time Type:
Full time
------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.
------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
Similar Jobs
View All
1 Day ago
Front End Developer
Information Technology
- 200000 - 300000 INR - Yearly
- Bangalore, Karnataka, India
About the job:Key responsibilities: 1. Thorough understanding and proficient React.js, JavaScript, HTML5 and CSS3 skills. 2. Expert in user interface development, engineering cross-browser and cross device compliant code. 3. Translating designs and...
1 Day ago
Associate Software Tester - Fresher
Information Technology
- 210000 - 210000 INR - Yearly
- Bangalore, Karnataka, India
About the job:As an Associate Software Tester at Ruminate Technology, you will be an integral part of our dynamic and innovative team. You will have the opportunity to work on cutting-edge projects and shape the future of our products. We are looking...
1 Day ago
Web Developer
Information Technology
- 200000 - 300000 INR - Yearly
- Bangalore, Karnataka, India
About the job:Must know how to create a winning website Digital Marketing Agency candidate preferred Self-directed and capable of working in a fast-paced environment. Experience with an e-commerce website will be preferred We are looking for a skill...
1 Day ago
IT System Administrator
Information Technology
- 20000 - 30000 INR - Monthly
- Bangalore, Karnataka, India
We are seeking a skilled and motivated individual to join our team as an IT Support and Networking Specialist. The successful candidate will be responsible for monitoring networking and security aspects across our offices in India and Malaysia. They ...
1 Day ago
IT Trainer
Information Technology
- 6000 - 12000 INR - Monthly
- Bangalore, Karnataka, India
We are seeking a skilled and passionate React.js Trainer to join our institute. The trainer will be responsible for delivering comprehensive training sessions, mentoring students, and ensuring they gain strong practical knowledge of React.js and rela...
1 Day ago
IT Executive
Information Technology
- 15000 - 25000 INR - Monthly
- Bangalore, Karnataka, India
WantedIT ExecutiveDuty 9 hrsstrategic planning, management,implementation of technology to support healthcare operations, encompassing IT infrastructure, data security, regulatory compliance,team leadership. Job Type: Full-timePay: ₹15,000.00 - ₹25,0...
1 Day ago
Assistant IT Technician
Information Technology
- 20000 - 20000 INR - Monthly
- Bangalore, Karnataka, India
Troubleshooting and Problem Solving: Diagnosing and resolving hardware, software, and network issues for users.Installation and Configuration: Setting up and configuring computer systems, software, and peripherals.User Support: Providing technical as...
1 Day ago
Brainvire Infotech - Data Analyst - Power BI
Information Technology
- Bangalore, Karnataka, India
Job DescriptionKey Responsibilities : Extract, clean, and analyze data using SQL to support business needs. Develop interactive and insightful dashboards and reports using Power BI. Write efficient and complex DAX queries for data modeling and ca...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in