Responsibilites:
- Work with a mix of cloud infrastructure and open-source technologies to build, scale, and maintain first-party data workloads.
- Implement and manage both streaming and batch data pipelines.
- Drive audience and behavioral analytics, as well as key business metrics with associated reporting.
- Collaborate with both product engineering and data science teams.
- Ensure sound data governance from collection to storage and activation of a broad range of data products.
- Support the business’s goal of democratization of data.
Requirements
- Experience in data-related languages and frameworks such as Spark, AirFlow, Python, SQL, Kafka.
- Experience in operating data lakes on Amazon S3.
- Experience in operating data warehouses and/or query engines such as Presto.
- Experience in AWS data and analytics services such as Glue, Kinesis, or QuickSight.
- Understanding of data modelling and data governance.
- You have at least 3 years of experience in cloud-based data engineering.