The Data Services Team is responsible for the developer platform, and the impressive Amazon AWS estate Vortexa uses to achieve its purpose. This includes two major areas of concern: infrastructure availability, security and costs, as well as developer experience. We use a wide variety of technologies like Kubernetes, Golang, Kafka, Opensearch, Airflow, Athena, and others.
You will be a key member of the small, globally distributed team, instrumental in assessing current technologies, delivering the best possible engineering experience with the shortest development iterations, helping crystallise, converge and standardise technology stacks and implementing the infrastructure roadmap, ensuring 100% uptime, availability, and fault-tolerance of every component of the platform, while optimising AWS costs. You will provide your customers such as data analysts, data scientists, and other engineers with a delightful developer experience tooling boosting their productivity, and allowing them to concentrate on business logic. You will codify and automate any operational knowledge gathered so that R&D can focus purely on creating value for our customers.
You will look after multiple mature CI/CD pipelines and ensure they grow and adapt to the infrastructure. Your customers would be data analysts, data scientists, and other engineers and industry experts from across the company.
You Are:
- Determined to create infrastructure that gets out of the way with a great developer experience
- Excellent at troubleshooting unfamiliar code.
- Striving to be more skilled than Google with Kubernetes
- An AWS power user and evangelist
- Familiar with Apache Kafka and Kafka Streams – deployment, monitoring, resiliency, fault-tolerance, cluster planning and operations, applications debugging
- Experienced with ElasticSearch operations and usage
- Fluent in Terraform, and Go
- Familiar with cloud-native application design and deployment
- Not afraid of challenges and infrastructure troubleshooting
- A “can-do” person – “I’ve done my bit” has no place at Vortexa
Awesome if you:
- Are familiar with Airflow or other workflow orchestration tools
- Understand data lakes like Parquet, Orc, Athena