Lead System Administrator - Hadoop

Sr/ Lead Engineer – Hadoop

Let’s be unstoppable together!

At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities (with us you can always bring your full self to work). Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Learn more at www.circana.com.

Job Responsibilities

• Experience in installing, configuration, Supporting and Managing of MapR and ODP Apache Hadoop Cluster with Ambari.
• Experiencing in installing and configuring components HDFS, MapReduce, TEZ, Hive, Yarn, Sqoop, Oozie, HBase, Scala, Spark, Kafka in Hadoop ecosystems.
• Worked with Ambari and MCS ( MapR ) for monitoring and administrating the Hadoop Multi Node Clusters.
• Expert in Administrating and Managing ODP Apache Hadoop Cluster with Ambari, DR and MapR.
• Experience in Administrating the Linux/Unix systems to deploy Hadoop Clusters.
• Expertise in Monitoring multiple Hadoop Clusters environments using Ambari Metrics, MCS and Grafana.
• Configuring Name Node, Data Node, Resource Manager and HiveServer2 High Availability and Clusters service coordination using Zookeeper.
• Performing Backup, Disaster Recovery, Root Cause Analysis for Hadoop and Troubleshooting Hadoop Cluster issues.
• Importing and Exporting Data between Relational Database Systems (RDBMS) and HDFS using Sqoop.
• Hands on Experience in Configuring Kerberos for Authentication.
• Experience in maintaining and monitoring the MapR and Ambari
• Proficient in performing Minor and Major Upgrades, Commissioning and Decommissioning of data nodes on Hadoop Cluster.
• Experience in integrating Hadoop Cluster components with LDAP, Active Directory and enabling SSL for Hadoop Cluster Components.
• Experiencing writing Hive queries using Hive Query Language HiveQL.
• Strong working knowledge in writing queries in SQL.
• Experience in monitoring the kerberized Hadoop Cluster using Grafana.
• Experience in Installation, Configuration, Backup, Recovery, Maintenance, Support of Linux.
• Extensive knowledge on Hadoop Application Frameworks like Hive and Spark.
• Experience with System Integration, Capacity Planning, Performance Tuning, System Monitoring, System Security and Load Balancing.
• Excellent Knowledge on YUM and RPM Package Administration for Installing, Upgrading and Checking dependencies.
• Very good knowledge on python Familiar with Java.
• Knowledge on Sudoers Configuration and administration on Red Hat Linux Environment.

Requirements

• 5+ years of Hadoop Administration and Linux/Unix Experience
• Demonstrated success in communication, collaboration and motivation of cross-functional departments to achieve exceptional service.
• Strategic thinking, complex problem solving and analytical capabilities.
• Excellent Communication, diagnostic and issue resolution skills
• Ability to see the big-picture and take a holistic approach to problem-solving.
• Ability to take complex information and communicate in a manner that is understandable to all audiences.
• Demonstrated understanding of the evolving landscape of technology.
• Ability to effectively network with colleagues to share knowledge and gain new perspectives.

Technical Skills:

• Hadoop Distribution: MapR, Apache Hadoop (ODP), Cloudera/Hortonworks.
• Hadoop Ecosystem: HDFS, MapReduce, YARN, Hive, Sqoop, Zookeeper, HBase, Spark.
• Configuration Management: Ambari, MapR, and Cloudera Manager.
• Security: LDAP, AD SSL, and Kerberos.
• Languages: SQL, Shell Scripting, bash, Spark SQL, HiveQL.
• Databases: MySQL, PostgreSQL.
• Monitoring Tools: Ambari, Grafana, Kibana.
• Package Management: RPM, YUM.
• Networking and Protocols: LAN, WAN, TCP/IP, NFS, LDAP, DNS.
• Operating Systems: RHEL, Oracle Enterprise Linux, Cent OS, Ubuntu.
• Job Scheduling Tools: Crontab, Airflow, Oozie.

Circana Behaviors

As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role:

• Stay Curious: Being hungry to learn and grow, always asking the big questions
• Seek Clarity: Embracing complexity to create clarity and inspire action
• Own the Outcome: Being accountable for decisions and taking ownership of our choices
• Center on the Client: Relentlessly adding value for our customers
• Be a Challenger: Never complacent, always striving for continuous improvement
• Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
• Commit to each other: Contributing to making Circana a great place to work for everyone

Location

This position can be located in the following area(s): Bangalore

Prospective candidates may be asked to consent to background checks (in accordance with local legislation and our candidate privacy notice ) Your current employer will not be contacted without your permission.