Hadoop Administrator

Mandatory Skills

4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.
Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.
Linux experience (RedHat, CentOS, Ubuntu).
Experience in setting up and supporting Hadoop environment (Cloud and On-premises).
Ability to setup, configure and implement security for Hadoop clusters using Kerberos.
Ability to implement data-at-rest encryption (required), data-in-transit encryption(optional). Ability to setup and troubleshoot Data Replication peers and policies.
Experience in setting up services like YARN, HDFS, Zookeeper, Hive, Spark, HBase etc.
Willing to work in 24x7 rotating shifts including weekends and public holidays.
Knows Hadoop command line interface.
Scripting background (shell/bash, python etc.)- automation, configuration management.
Knowledge of Ranger, SSL, Atlas etc.
Knowledge of Hadoop data related Auditing methods.
Excellent communication, interpersonal skills.
Ability to closely work with the infrastructure, networking, development teams.
Setting up the platform using AWS cloud native services