- Plan, install, configure, and deploy Hadoop clusters based on business requirements and workload demands.
- Monitor and manage the health of Hadoop clusters, addressing performance issues and ensuring optimal resource utilization.
- Implement and maintain security protocols within the Hadoop ecosystem, including authentication, authorization, and encryption.
- Develop and implement backup and recovery strategies for Hadoop data, ensuring data integrity and availability.
- Perform capacity planning to anticipate future storage and processing needs, and scale the infrastructure accordingly.
- Optimize Hadoop cluster performance by fine-tuning configurations, troubleshooting bottlenecks, and implementing best practices.
- Manage software upgrades, patches, and version updates for Hadoop components to ensure stability and security.
- Implement monitoring tools to track the performance of Hadoop clusters and set up logging mechanisms for analysis and troubleshooting.
- Administer user access and permissions to Hadoop clusters, maintaining a secure and controlled environment.
- Develop and test disaster recovery plans to ensure data availability in case of unexpected events or failures.
- Maintain comprehensive documentation for configurations, procedures, and troubleshooting guides for the Hadoop environment.
- Implement automation scripts for routine tasks, making the administration processes more efficient
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Hadoop Administrator in large-scale environments.
- Proficiency in Hadoop distributions like Apache Hadoop, Cloudera, Hortonworks, etc.
- Strong understanding of Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, etc.).
- Knowledge of Linux system administration.
- Scripting skills (e.g., Shell, Python) for automation.
- Familiarity with cloud platforms (e.g., AWS, Azure) is a plus.
- Excellent problem-solving and troubleshooting skills.
#hadoopadmin #singaporejobs #hadoopadministrator #bigdataadmin #Hadoop #clouderaadmin #ITsingapore
