Job Title: Hadoop Administrator
Job Description:We are seeking an experienced Hadoop Administrator with 4-6 years of hands-on experience in managing and maintaining Hadoop clusters. As a Hadoop Administrator, you will be responsible for installing, configuring, and optimizing our Hadoop ecosystem to ensure high availability and reliability. You will work closely with cross-functional teams to deploy new features and enhancements, monitor system performance, and implement security measures.
Key Responsibilities:
- Installing, configuring, and managing Hadoop clusters and ecosystem components (HDFS, YARN, MapReduce).
- Monitoring cluster health and performance to optimize performance and resource utilization.
- Implementing security and access controls for Hadoop clusters.
- Performing capacity planning and scaling of Hadoop clusters based on business needs.
- Collaborating with data engineers and analysts to deploy data pipelines and workflows.
- Troubleshooting and resolving issues related to Hadoop infrastructure and applications.
- Documenting Hadoop cluster configurations, processes, and procedures.
Required Skills:
- 4-6 years of experience as a Hadoop Administrator or similar role.
- Hands-on experience with Hadoop ecosystem components (HDFS, YARN, MapReduce).
- Proficiency in Linux operating system and shell scripting.
- Strong understanding of network configurations and protocols.
- Experience with monitoring tools and frameworks (e.g., Nagios, Ganglia).
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills.
