Responsibilities:
- Be the Hadoop Subject Matter Expert to engage with customers to provide technological solutions as well as operational improvement recommendations Hadoop infrastructure platforms & Hadoop eco-system incl. Linux & storage
- Lead the teams on technical directions for the different Hadoop platforms that run 24x7 and support customer critical production operations
- Major Incident support (service recovering & root cause troubleshooting) for Hadoop and Hadoop eco-system incl. Linux & storage related issues, including communications to senior management and customer.
¡ Required to get âhands-onâ where needed and work along the technical team
¡ Support the Hadoop Platform with the tools OOZIE, Apache Ni Fi, Java & Unix must knowledge
¡ Well-versed knowledge on Network, Storage and APIâs creation and debugging
¡ Knowledge on supporting the applications on Big data platform and Debugging knowledge of YARN
¡ Write/debug Python code for the designed frameworks
¡ Control the Hadoop clusters with proper access controls and apply the security with the tools Ranger, Kerberos
¡ Coordinate with product vendors to setup/configure infrastructure, network, nodes
¡ Write automation scripts for any alerts and monitoring dashboards from automation perspective with Python
¡ Maintaining and troubleshooting the Environment with Ambari
¡ Integrate Solution knowledge between Hadoop and Reporting tools like Tableau, MicroStrategy, SAS, HDF
¡ Solutioning different Disaster Recovery approaches for Bigdata
¡ Tuning and scaling up clusters with several proposals
¡ Migrating the HDP clusters to CDP cluster or to the Azure cloud
Skillset:
¡ Hadoop Hortonworks admin or support L3 Knowledge
¡ Cloudera data platform admin
¡ Hive /Hbase SQL Tuning for map reducer jobs
¡ Shell/ Python Scripting experience
¡ Certification CDP Administration
¡ Certification RedHat Linux Administration added advantage
¡ MySQL/postgreSQL knowledge
¡ VMware Virtualization knowledge preferred.
¡ Knowledge on Pure and Isilon storage, S3 file systems is added-advantage
¡ Must be able to engage with technical people but also with semi-technical senior stakeholders and customerâs application teams
Years of Experience:
7 to 12 years overall Experience and 5+ Years of Big data Engineering and Production support