Responsibilities:
- Be the Hadoop Subject Matter Expert to engage with customers to provide technological solutions as well as operational improvement recommendations Hadoop infrastructure platforms & Hadoop eco-system incl. Linux & storage
- Lead the teams on technical directions for the different Hadoop platforms that run 24x7 and support customer critical production operations
- Major Incident support (service recovering & root cause troubleshooting) for Hadoop and Hadoop eco-system incl. Linux & storage related issues, including communications to senior management and customer.
· Required to get “hands-on” where needed and work along the technical team
· Support the Hadoop Platform with the tools OOZIE, Apache Ni Fi, Java & Unix must knowledge
· Well-versed knowledge on Network, Storage and API’s creation and debugging
· Knowledge on supporting the applications on Big data platform and Debugging knowledge of YARN
· Write/debug Python code for the designed frameworks
· Control the Hadoop clusters with proper access controls and apply the security with the tools Ranger, Kerberos
· Coordinate with product vendors to setup/configure infrastructure, network, nodes
· Write automation scripts for any alerts and monitoring dashboards from automation perspective with Python
· Maintaining and troubleshooting the Environment with Ambari
· Integrate Solution knowledge between Hadoop and Reporting tools like Tableau, MicroStrategy, SAS, HDF
· Solutioning different Disaster Recovery approaches for Bigdata
· Tuning and scaling up clusters with several proposals
· Migrating the HDP clusters to CDP cluster or to the Azure cloud
Skillset:
· Hadoop Hortonworks admin or support L3 Knowledge
· Cloudera data platform admin
· Hive /Hbase SQL Tuning for map reducer jobs
· Shell/ Python Scripting experience
· Certification CDP Administration
· Certification RedHat Linux Administration added advantage
· MySQL/postgreSQL knowledge
· VMware Virtualization knowledge preferred.
· Knowledge on Pure and Isilon storage, S3 file systems is added-advantage
· Must be able to engage with technical people but also with semi-technical senior stakeholders and customer’s application teams
Years of Experience:
7 to 12 years overall Experience and 5+ Years of Big data Engineering and Production support
