Big Data Engineer II

Overview

This position is epected to be engaged during solutions design and defining detailed execution plan. Transforming the data using Bigdata tools. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. Will be responsible for integrating them with the architecture used across the company.

Job Responsibilities

• Ingesting huge volumes data from various platforms for Analytics needs.
• Building and Implementing ETL process developed using Big data tools such as Spark (Scala/python), Hbase, Apache Solr, Kafka, NiFi etc.
• Monitoring performance and advising any necessary infrastructure changes.
• Defining data security principals and policies using Ranger and Kerberos.
• Works with IT and business customers to develop and design requirements to formulate technical design.
• Supervisory Responsibilities: Leads and motivates project team members that are not direct reports, as well as providing work direction to lower-level staff members
• Skills to understand the right functional domain knowledge of the business to be able to gather right requirements for the design.
  
  
  

• Bachelor's degree in Computer Science, Engineering, or related discipline
  
  
  

• 4 to 6 years of solutions development experience
• Proficient understanding of distributed computing principles
• Experience in building a Datalake using BigData Ecosystems.
  
  
  

(general and technical)

• Strong knowledge on BigData Technologies – Spark, Scala, Hbase, MongoDB, Graph DB, ETL (SQL, Hive, NoSQL, Informatica), Kafka, Splunk, Solr, Shell scripting, Python etc.
• Cloud Analytics technologies – Azure, AWS, GCP
• Strong programming background – Core Java
  
  
  

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World’s 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.

Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we’re inspired to transform the next century in financial services. At MetLife, it’s #AllTogetherPossible . Join us!