Our reputable client is looking for a highly motivated Data Engineer to join their team in Singapore.
Responsibilities
· Work on the entire data production by implementing data ingestion pipelines (from multiple sources and in different formats), storage, transformation, then their provision: datamarts, cube, reports, datasets to feed models scoring (data science), API, mainly using Dataiku and Google BigQuery
· Ensure that the integration pipelines are designed in a manner consistent with the overall data framework in collaboration with the HQ’s data tech lead and according to best practices/ define framework
· Be part of a continuous improvement approach by optimizing and reusing existing assets for streamline.
· Take part in data integration processing aspects of data quality controls, monitoring, alerting and technical documentation, as well as data management (data models and mapping, data documentation, repositories, description of the transformations applied, etc.)
· Acquire a good understanding and analysis of business challenges and be able to translate the needs into the design of concrete technical solutions and gradually extend the functionalities and scope of our data platform based on Google cloud platform and Dataiku.
· Provide reliable estimates of workloads and planning according to the level of complexity and other activities to allow a good coordination of the activities of the team.
· Perform unit development tests and support business users in their tests before final validation.
· Contribute to the design and management of the data model, as well as to the orientations in terms of the architecture of our data platform (repositories, APIs, etc.)
· Set up pipeline monitoring and monitoring of the data platform and APIs (from a functional point of view and data quality)
Skills/Requirement:
· Mastery of the data stack components in Google Cloud Platform (certifications appreciated) including but not limited to: Google Big Query (nested fields, partitioning, merge SQL, authorized views, RLS), Cloud storage, Cloud functions, Cloud composer, Google Firestore, Google data catalog or similar services of other cloud services.
· Proficiency of Dataiku (on Google big query): development of dataiku flows, implementation of scenarios, scheduling, management of versioning, releases into production, administration etc.
· Mastery of complex SQL queries
· Good knowledge of Python is a plus
· Development practices with data exchange architectures: webservice, API, streaming.
· Development in an agile team and the tools used in CI / CD (Git, Bash, CLI, Azure devops, Jira, Confluence)
Knowledge of Microsoft Power BI, data catalog tool, data quality, data management
We regret to inform that only shortlisted candidates will be contacted.
PERSOLKELLY Singapore Pte Ltd • EA License No. 01C4394 • EA Registration No. R1551626 (SUJA THERESA FRANCIS)
**********************************
The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.
By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOLKELLY Singapore Pte Ltd and its local and overseas subsidiaries and affiliates collecting, using and disclosing your personal data to prospective employers/companies based in any country for purposes of evaluating suitability for employment, conducting reference checks, administering employment related services and such other purposes stated in our privacy policy. Our full privacy policy is available at www.persolkelly.com.sg. If you wish to withdraw your consent, please drop us an emailto let us know. Please feel free to contact us if you have any queries.
All parties involved in any form of workforce engagement are to strictly adhere to prevailing regulations and laws that govern local fair employment practices, and to invest reasonable efforts in building a strong Singaporean core workforce, recruit and select candidates based on merit and prohibit discrimination based on age, race, gender, religion, marital status and family responsibility or disability. For more information, please refer to MOM and TAFEP websites.
**********************************
