We are looking for a talented Data Engineer (Remote) to join our team and contribute to building our data platform, utilizing cutting-edge technologies such as Dagster, Starburst, and S3 in its architecture.
This is a 100% remote position, following Singapore hours, therefore candidates must be based in the similar timezone.
What you will do :
- Design, develop, and maintain robust ELT pipelines for data ingestion, processing, and storage.
- Our tools of choice are: Dagster for orchestration, Starburst (Trino-based) Galaxy as a query engine, dbt for transformations, and Amazon S3 + Iceberg for an open data lakehouse.
- Implement and manage a data platform using modern data stack.
- Centralize data from multiple diverse sources into the data lakehouse.
- Collaborate with data science and analytics teams to understand data needs and provide optimal solutions.
- Ensure data quality, integrity, and governance.
- Optimize the performance of data management systems and troubleshoot technical issues related to data flows.
- Participate in the automation of data processes and continuous integration/continuous deployment (CI/CD) of data workflows.
