Big Data Engineer Senior Consultant

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.

Job Description

This role is responsible for driving multiple complex tracks of work to deliver Big Data solutions enabling advanced data science and analytics. This includes working with the team on new Big Data systems for analyzing data; the coding & development of advanced analytics solutions to make/optimize business decisions and processes; integrating new tools to improve descriptive, predictive, and prescriptive analytics; and discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions. This role contributes to the structured and unstructured Big Data / Data Science tools of Allstate from traditional to emerging analytics technologies and methods. The role is responsible for assisting in the selection and development of other team members.

Skills Primarily:

Scala & Spark: Strong in functional programming and big data processing using Spark...

Java: Proficient in Java 8+, REST API development, multithreading, and OOP concepts.

Good Hands-on with MongoDB

CAAS: Experience with Docker, Kubernetes, and deploying containerized apps.

Tools: Git, CI/CD, JSON, SBT/Maven, Agile methodologies.

Key Responsibilities

• Uses new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems
• Participates in the development of complex prototypes and department applications that integrate Big Data and advanced analytics to make business decisions
• Supports Innovation; regularly provides new ideas to help people, process, and technology that interact with analytic ecosystem
• Participates in the development of complex technical solutions using Big Data techniques in data & analytics processes
• Influence within the team on the effectiveness of Big Data systems to solve their business problems.
• Leverages and uses Big Data best practices / lessons learned to develop technical solutions used for descriptive analytics, ETL, predictive modeling, and prescriptive “real time decisions” analytics
• Partners closely with team members on Big Data solutions for our data science community and analytic users
• Partners with Allstate Technology teams on Big Data efforts
  
  

Education

• Masters Degree (Preferred)
  
  

Experience

• 6 or more years of experience (Preferred)
  
  

Primary Skills

Apache Spark, Big Data, Big Data Engineering, Big Data Systems, Big Data Technologies, CasaXPS, CI/CD, Data Science, Docker (Software), Git, Influencing Others, Java, MongoDB, Multithreading, RESTful APIs, Scala (Programming Language), ScalaTest, Spring Boot

Shift Time

Recruiter Info

rkotz@allstate.com

About Allstate

The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.

Learn more about Allstate India here.