Data Engineer - Cloud
SCOPE OF THE ROLE
You will be responsible for the end-to-end software development and support for all work related to projects, quarterly change requests, L3 production fixes. This includes software product implementation and administration, application design, development, implementation, testing and support. You will be expected to work on Kubernetes based platforms.
You will also be responsible for quality assurance of the team’s delivery in conformance with the Bank-defined software delivery methodology and tools. You will partner with other technology functions to help deliver required technology solutions.
Other responsibilities include:
- Create frameworks, technical features which helps in faster implementation of OpenShift Kubernetes based applicationsCarry out POCs involving new data technologies, new container platforms, sidecars, daemonsets
- Design and develop application frameworks for container integration
- Create technical documents such as solution design, program specifications for target solutions
- Perform design and development of applications which may not be limited to: Software Applications, Data Integration, User Interfaces, Automation
- Maintain and recommend software improvements to ensure a platform centric management of software applications
- Performance tuning
- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
- Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software
- Independently install, customise and integrate software packages, programs, product releases
Functional skillsets
Hands-on experience in implementing large scale data warehouse & analytics platforms in financial services industry with good functional knowledge of products & services offered in Retail bank / Wholesale / Global Markets covering some of the following analytics domains:
- Experience in deploying stateless, stateful workloads on OpenShift Kubernetes based platformExperience in developing microservices applications using node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis
- Experience in developing frameworks using Spark, Scala, Java, PythonExperience in working with in-memory applications
- Strong knowledge of Operating Systems
- Experience in container deployment management using either Helm Package manager or Kustomize
- Experience in integrating container applications with an external security vault such as CyberArk Conjur, AAM
- Experience in deployment automation of container applications using Jenkins, Jfrog, Gradle, Bitbucket, Groovy
Expertise in implementing appropriate security of data (SSL, Encryption)
Expertise in Load balancing and replication, scheduling
- Good knowledge of Custom Resources, Docker, Taints & tolerances, Node affinity, ConfigMapsExperience in Shell scripting, Control-MExpertise in design of role based fine grained access control
- Supporting application failures, planning for resiliency, Back-up Recovery
Technical skillsets
Cloud Engineer
- Platforms provided by IBM Cloud Pak for Data (CP4D) Kubernetes based platforms such as OpenShift, AWS, Azure, GCPSoftware defined storage (ODF)IBM Storage FusionS3 compatible storage options (Dell ECS, HCP)Node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis
- Scala, Java, PythonHelm Package manager, Kustomize
- Jenkins, Jfrog, Gradle, Bitbucket, Groovy Shell scripting, Docker
Splunk, Prometheus, Geneous
At least, 2 to 3 technical certifications in any of the below technologies:
- OpenShiftKubernetes, DockerLanguage – SQL, Java, Python, ScalaAutomation / scripting – CtrlM, Shell Scripting, Groovy
Additional Experience required for all teams to create an added advantage:
- CI/CD software, Testing Tools - Jenkins, SonarQube
- Version Control Tool - Aldon+LMe, CA Endeavor
- Deployment Tool kit -Jenkins
- Service or Incident Management (IcM) Tools - Remedy
- Source Code Repository Tool - Bitbucket
- Scheduling Tool - Control-M
- Defect Management Tool - JIRA
- Application Testing tool – QuerySurge
- Cloud certification