Data Engineer - Cloud
Expected Years of Experience: 5 – 10 years of experience
SCOPE OF THE ROLE
You will be responsible for the end-to-end software development and support for all work related to projects, quarterly change requests, L3 production fixes. This includes software product implementation and administration, application design, development, implementation, testing and support. You will be expected to work on Kubernetes based platforms.
You will also be responsible for quality assurance of the team’s delivery in conformance with the Bank-defined software delivery methodology and tools. You will partner with other technology functions to help deliver required technology solutions.
Other responsibilities include:
- Create frameworks, technical features which helps in faster implementation of OpenShift Kubernetes based applications
- Carry out POCs involving new data technologies, new container platforms, sidecars, daemonsets
- Design and develop application frameworks for container integration
- Create technical documents such as solution design, program specifications for target solutions
- Perform design and development of applications which may not be limited to: Software Applications, Data Integration, User Interfaces, Automation
- Maintain and recommend software improvements to ensure a platform centric management of software applications
- Performance tuning
- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
- Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software
- Independently install, customise and integrate software packages, programs, product releases
Functional skillsets
Hands-on experience in implementing large scale data warehouse & analytics platforms in financial services industry with good functional knowledge of products & services offered in Retail bank / Wholesale / Global Markets covering some of the following analytics domains:
- Experience in deploying stateless, stateful workloads on OpenShift Kubernetes based platform
- Experience in developing microservices applications using node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis
- Experience in developing frameworks using Spark, Scala, Java, Python
- Experience in working with in-memory applications
- Strong knowledge of Operating Systems
- Experience in container deployment management using either Helm Package manager or Kustomize
- Experience in integrating container applications with an external security vault such as CyberArk Conjur, AAM
- Experience in deployment automation of container applications using Jenkins, Jfrog, Gradle, Bitbucket, Groovy
- Expertise in implementing appropriate security of data (SSL, Encryption)
- Expertise in Load balancing and replication, scheduling
- Good knowledge of Custom Resources, Docker, Taints & tolerances, Node affinity, ConfigMaps
- Experience in Shell scripting, Control-M
- Expertise in design of role based fine grained access control
- Supporting application failures, planning for resiliency, Back-up Recovery
Technical skillsets
Cloud Engineer
- Platforms provided by IBM Cloud Pak for Data (CP4D)
- Kubernetes based platforms such as OpenShift, AWS, Azure, GCP
- Software defined storage (ODF)
- IBM Storage Fusion
- S3 compatible storage options (Dell ECS, HCP)
- Node js, React, Java, RabbitMQ, Akka framework, Apache Consul, Apache Geode, Redis
- Scala, Java, Python
- Helm Package manager, Kustomize
- Jenkins, Jfrog, Gradle, Bitbucket, Groovy
- Shell scripting, Docker
- Splunk, Prometheus, Geneous
At least, 2 to 3 technical certifications in any of the below technologies:
1. OpenShift
2. Kubernetes, Docker
3. Language – SQL, Java, Python, Scala
4. Automation / scripting – CtrlM, Shell Scripting, Groovy
Additional Experience required for all teams to create an added advantage:
1. CI/CD software, Testing Tools - Jenkins, SonarQube
2. Version Control Tool - Aldon+LMe, CA Endeavor
3. Deployment Tool kit -Jenkins
4. Service or Incident Management (IcM) Tools - Remedy
5. Source Code Repository Tool - Bitbucket
6. Scheduling Tool - Control-M
7. Defect Management Tool - JIRA
8. Application Testing tool – QuerySurge
9. Cloud certification
EDUCATION
- Bachelor’s degree/University degree in Computer Science, Engineering, or equivalent experience
WHAT WILL HELP YOU SUCCEED IN THIS ROLE
- Adopt an uncompromising attitude when it comes to quality and help raise bar of products and team members
- Be a team player who communicates effectively and professionally with both internal and external customers
- Identify ideas to improve system performance and impact availability
- Embrace tackling and resolving complex technical design issues
- Possess strong problem solving and decision-making skills while exercising good judgment
- Strong analytical and problem-solving skills
- Ability to work on multiple projects at a time
- Be able to work under pressure and manage deadlines or unexpected changes in expectations or requirements
- Good communication skills - ability to convey technical information to non-technical audience
- Ability to understand the big picture
- Ability to develop long lasting relationships with all levels
- Deep understanding and experience in software development cycle, including Agile based rapid delivery
- Collaborate with business and IT to analyse, elicit and review business requirements
- Facilitate communication between vendor, project team, business stakeholders and internal IT team
- Ability to work in a team distributed across multiple locations
