Data Engineer
- 6 months contract with a possibility of extension
- Work location: CBD
Our Client
- MNC IT company
The Opportunity
- Work across workstreams to support data requirements including reports and dashboards
- Analyze and perform data profiling to understand data patterns and discrepancies following Data Quality and Data Management processes
- Understand and follow best practices to design and develop the E2E Data Pipeline: data transformation, ingestion, processing, and surfacing of data for large-scale applications
- Understand business requirements to translate them into technical requirements that the system analysts and other technical team members can drive into the project design and delivery
- Analyze source data and perform data ingestion in both batch and real-time patterns via various methods; for example, file transfer, API, Data Streaming using Kafka and Spark Streaming
- Analyze and understand data processing and standardization requirements, develop ETL using Spark processing to transform data
- Understand data/reports and dashboards requirements, develop data export, data API, or data visualization using Power BI, Tableau, or other visualization tools
Your Background
- More than 3 years of experience in data engineering fields
- Data Engineering skills: Python and Databricks
- Preferably with working experience in AWS cloud
Interested parties please click "Apply Now" or contact May Anne Ramos (EA Reg no: R1110127) at [email protected] for more information.
Peoplebank Singapore Pte Ltd, EA Licence Number: 08C5248.
