Role: Data Engineer (Cloud)
Industry: Banking
Responsibilities & Requirements
- Minimum 5~10 years of experience
- Create frameworks, technical features which helps in faster implementation of OpenShift Kubernetes based applications
- Carry out POCs involving new data technologies, new container platforms, sidecars, daemonsets
- Design and develop application frameworks for container integration
- Create technical documents such as solution design, program specifications for target solutions
- Perform design and development of applications which may not be limited to: Software Applications, Data Integration, User Interfaces, Automation
- Maintain and recommend software improvements to ensure a platform centric management of software applications
- Performance tuning
- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
- Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software
- Independently install, customise and integrate software packages, programs, product releases
Functional skillsets
Hands-on experience in implementing large scale data warehouse & analytics platforms in financial services industry with good functional knowledge of products & services offered in Retail bank / Wholesale / Global Markets covering some of the following analytics domains:
- Experience in deploying stateless, stateful workloads on OpenShift Kubernetes based platform
- Experience in developing microservices applications using node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis
- Experience in developing frameworks using Spark, Scala, Java, Python
- Experience in working with in-memory applications
- Strong knowledge of Operating Systems
- Experience in container deployment management using either Helm Package manager or Kustomize
- Experience in integrating container applications with an external security vault such as CyberArk Conjur, AAM
- Experience in deployment automation of container applications using Jenkins, Jfrog, Gradle, Bitbucket, Groovy
- Expertise in implementing appropriate security of data (SSL, Encryption)
- Expertise in Load balancing and replication, scheduling
- Good knowledge of Custom Resources, Docker, Taints & tolerances, Node affinity, ConfigMaps
- Experience in Shell scripting, Control-M
- Expertise in design of role based fine grained access control
- Supporting application failures, planning for resiliency, Back-up Recovery
Technical skillsets (At least 2 to 3 certified)
- Platforms provided by IBM Cloud Pak for Data (CP4D)
- Kubernetes based platforms such as OpenShift, AWS, Azure, GCP
- Software defined storage (ODF)
- IBM Storage Fusion
- S3 compatible storage options (Dell ECS, HCP)
- Node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis
- Scala, Java, Python
- Helm Package manager, Kustomize
- Jenkins, Jfrog, Gradle, Bitbucket, Groovy
- Shell scripting, Docker
- Splunk, Prometheus, Geneous
