This will be a 2-years contract position.
Responsibilities
- Data requirements translation from business into technical specifications.
- Engage partners on technology stack, infrastructure and security alignment.
- Building data products, architecting and building ingestion pipelines to collect, clean, merge, and harmonize data.
- Monitor databases and ETL systems
- Database capacity planning and maintenance, monitoring, and performance tuning
- Identify issues and deploy measures to prevent recurrence
- Ensure maximum database uptime;
- Depending on data needs of end users, construct, test, and update useful and reusable data models.
- Access data warehouse by designing and building secure mechanisms for end users and systems.
- Improve agency data infrastructure by researching, proposing and developing new technologies and processes.
- Engage data stewards to establish and enforce data governance policies, best practices and procedures.
- Responsible for data catalogue to document data assets, metadata and lineage.
- Execute data quality checks and validation processes for data accuracy and consistency.
- Execute and ensure data security best practices, including access control, encryption, and data masking.
Requirements
Degree holder preferably in Computer Science, Software Engineering, Information Technology, or related disciplines.
Expert in system design, data structure and algorithms, data modelling, data access, and data storage.
Experience and proficiency in:
- cloud technologies such as AWS, Azure, and Google Cloud.
- architecting data and IT systems.
- orchestration frameworks such as Airflow, Azure Data Factory.
- distributed data technologies such as Spark, Hadoop.
- programming languages such as Python, Java, or Scala.
- writing SQL for databases\
- building and using CI/CD pipelines.
- DevOps tools such as Docker, Git, Terraform.
Advantage to have experience in:
- designing, building, and maintaining batch and real-time data pipelines.
- Databricks.
- technical processes to enforce data security, data quality, and data governance.
- government systems and government's policies relating to data governance, data management, data infrastructure, and data security.
Ethos Search Associates Pte. Ltd.
EA Licence No: 13C6655
EA Reg No: R1988580 Jacky Chong
