Responsibilities
• Work with stakeholders including customers, partners and colleagues on data-related technical issues and support their data infrastructure needs;
• Work closely with data scientists to solicit data requirements to support modeling works;
• Design, develop, document, manage and maintain data models, ETL processes, data warehouse, data management and pipeline solutions for large volume of structured/unstructured data from disparate sources and with different latencies (e.g. on-demand, batch, real-time, near-real-time);
• Define, monitor and report SLAs for data pipelines and data products;
• Understand data security and governance standards or requirements to implement solutions that ensure adherence to these standards or meet such requirements;
• Drive/execute data quality assurance practices; and
• Support data management solutions pre-sales initiatives, proposal development and provide post-sales support.
Requirements
• Technical expertise in:
• Relational/non-relational/NoSQL database and enterprise data warehouse/mart;
• Big data technologies e.g. Hadoop, Spark, Hive, HBase etc.;
• Data ingestion technologies e.g. Flume, Kafka, NiFi etc.; and
• Scripting, programming and software development using e.g. Java, C/C++, Python, R, MATLAB, Scala, SQL etc. for Windows or Linux environments.
• More experienced candidates will be considered for the senior role
• Experience in master data management, data governance, data lifecycle management etc.;
• Experience in designing, documenting, implementing and supporting data management solutions;
• Experience in using software engineering best practices in development, programming, testing, version control etc.;
• Knowledge of data privacy and security assurance; and
• Knowledge of machine learning, computer vision and large language models will be advantageous.
• Excellent written and verbal communications skills;
• Highly organised, motivated, independent and resourceful team player;
• Strong analytical thinking, interpersonal and problem-solving skills; and
• Able to work productively in a matrix reporting and fast-paced environment
Licence no: 12C6060
