Free cookie consent management tool by TermsFeed Big Data Engineer Senior Consultant II | Antal Tech Jobs
Back to Jobs
3 Days ago

Big Data Engineer Senior Consultant II

decor
Mumbai, Maharashtra, India
Information Technology
Full-Time
Allstate

Overview

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.

Job Description

We are seeking a highly skilled and experienced Senior Big Data Consultant to join our data engineering team and lead the development of high-performance, real-time data solutions. This role is ideal for someone who thrives in a fast-paced environment, has a passion for streaming technologies, and can architect scalable data pipelines that drive business impact.

You will be responsible for designing, developing, and maintaining real-time data processing systems using Apache Flink, AWS Kinesis Data Analytics (KDA), and related AWS services. Your work will directly support critical analytics, reporting, and machine learning workloads by ensuring timely and reliable data availability. As a senior member of the team, you will collaborate closely with data scientists, product managers, and cloud engineers to build end-to-end solutions that support both internal business intelligence and customer-facing applications

Key Responsibilities

  • Design and develop real-time data processing applications using Apache Flink.
  • Build and optimize Kinesis Data Analytics (KDA) applications for low-latency stream processing.
  • Good knowledge on Scala or Java
  • Architect scalable, fault-tolerant solutions leveraging AWS services such as S3, Lambda, EMR, and Glue.
  • Work closely with product and data teams to translate business requirements into technical solutions.
  • Implement best practices for performance tuning, monitoring, and alerting of streaming pipelines.
  • Perform code reviews, mentor junior team members, and contribute to architecture discussions.
  • Ensure high availability, scalability, and reliability of data infrastructure.

Education

  • Masters Degree (Preferred)

Experience

  • 7 or more years of experience (Preferred)

Supervisory Responsibilities

  • This job does not have supervisory duties.

Education & Experience (in lieu)

  • In lieu of the above education requirements, an equivalent combination of education and experience may be considered.

Primary Skills

Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others

Shift Time

Shift B (India)

Recruiter Info

Annapurna Jha

ajhat@allstate.com

About Allstate

The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.

Learn more about Allstate India here.
Share job
Similar Jobs
View All
3 Hours ago
Devops Cloud Engineer
Information Technology
  • 3000000 - 3500000 INR - Monthly
  • 7 - 14 Yrs
  • Mumbai
Minimum Experience/Training Required: • At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment • Proven ability to work across structured, semi-structured, and unstructured d...
decor
1 Day ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
1 Day ago
Cybersecurity Engineer
Information Technology
  • 2 - 8 Yrs
  • Anywhere in India/Multiple Locations
Key Responsibilities: Design, implement, and manage Palo Alto Networks solutions, including: Next-Gen Firewall (NGFW) EDR/XDR (Cortex XDR) SIEM/SOAR (Cortex XSIAM) Lead and support migration projects from legacy platforms (e.g., Splunk,...
decor
1 Day ago
Application Developer
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Project Role :Application Developer Must have skills :.Net Full Stack Development Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processe...
decor
1 Day ago
Rosmerta Technologies - Software Java Developer - Spring Boot Framework
Information Technology
  • Pune, Maharashtra, India
Job SummaryWe are seeking a highly experienced and skilled Software Java Developer with a minimum of 8 years of experience to join our dynamic engineering team.The ideal candidate will be a seasoned professional with a strong foundation in Java back...
decor
1 Day ago
Machine Learning Engineer - NLP/Generative AI
Information Technology
  • Pune, Maharashtra, India
About UsWe are a UK-based conveyancing firm dedicated to transforming property transactions through cutting-edge artificial intelligence. We are seeking a talented Machine Learning Engineer with 12 years of experience to join our growing AI team. Th...
decor
1 Day ago
Lead Software Engineer-R-248730
Information Technology
  • Pune, Maharashtra, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
1 Day ago
Software Engineer - Java Full Stack Developer
Information Technology
  • Pune, Maharashtra, India
Job DescriptionAre you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovati...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media