Job Objectives
Manage Hadoop cluster in across all 4 environments (SIT, UAT, PROD and DR)
Key Responsibilities
· Manage Hadoop cluster across 4 different environments
· Ensure system is up and running 24 X 7
· Support user query or address any performance issue either with users query or system performance
Key Requirements
• Experience in managing large hadoop cluster with Cloudera CDH and CDP
• Experience in plan and execution of major and minor upgrades of Cloudera CDH and CDP
• Experience in administering various services within CDP including adding/deleting of nodes, supporting hardware replacements
• Posses good understanding of external tools integration with hadoop (qlik, PowerBI, SAS and Informatica)
• Experience in LDAP, SSHD and KRB authentications
• Experience in performing POC for open-source applications and tools
• Experience in performance tuning of various hadoop services and support end users in tuning application codes
• Backup and restore of various service components of hadoop cluster
• Certification in Cloudera CDH/CDP
• Scripting knowledge in Bash, Python and Perl, to automate and avoid repetitive tasks.
• Good technical knowledge of RHEL/Oracle Linux, and Unix hardware, operating system and system services will be an added advantage
