Description:
- Experience on Jobs Schedulers
- Experience with multiple large scale Enterprise Hadoop environment builds and operations including design, capacity planning, cluster setup, security, performance tuning and monitoring.
- Maintaining a Cloudera CDP 7.x cluster, adding and removing nodes using cluster monitoring tools ie Cloudera Manager
- Configuring the Cloudera high availability and keeping a track of all the running jobs.
- Managing and administering the overall Cloudera platforms/environments.
- Taking care of the day-to-day running of Hadoop clusters
- A Cloudera administrator will have to work closely with the data engineering and data science team, network team, BI team, testing teams and application teams to make sure that all the big data applications are highly available and performing as expected.
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the compute clusters. Monitoring the cluster connectivity and performance.
- Backup and recovery tasks
- Resource and security management using Kerberos , Ranger, Atlas, Data Encryption
- Troubleshooting application errors and ensuring that they do not occur again.
- Excellent verbal and communication skills.
