Our Client is an established company in Singapore, who is seeking to recruit a Senior Data Engineer (Data Science/ Artificial Intelligence).
Senior Data Engineer (Data Science/ Artificial Intelligence)
This role requires an individual with experience in cloud-based data engineering work, as well as good communication skills, as you will be expected to interact frequently with the users to elicit useful business information that enables you to perform your job.
Responsibilities
· Translate data requirements from business users into technical specifications.
· Collaborate with IT teams on technology stack, infrastructure and security alignment.
· Build out data product as part of a data team:
· Architect and build ingestion pipelines to collect, clean, merge, and harmonize data from different source systems.
· Day-to-day monitoring of databases and ETL systems, e.g., database capacity planning and maintenance, monitoring, and performance tuning; diagnose issues and deploy measures to prevent recurrence; ensure maximum database uptime;
· Construct, test, and update useful and reusable data models based on data needs of end users.
· Design and build secure mechanisms for end users and systems to access data in data warehouse.
· Research, propose and develop new technologies and processes to improve data infrastructure.
· Collaborate with data stewards to establish and enforce data governance policies, best practices and procedures.
· Maintain data catalogue to document data assets, metadata and lineage.
· Implement data quality checks and validation processes to ensure data accuracy and consistency.
· Implement and enforce data security best practices, including access control, encryption, and data masking, to safeguard sensitive data.
Requirements
· A Bachelor’s Degree, preferably in Computer Science, Software Engineering, Information Technology, or related disciplines.
· Deep understanding of system design, data structure and algorithms, data modelling, data access, and data storage.
· Demonstrated ability in using cloud technologies such as AWS, Azure, and Google Cloud.
· Experience in architecting data and IT systems.
· Experience with orchestration frameworks such as Airflow, Azure Data Factory.
· Experience with distributed data technologies such as Spark, Hadoop.
· Proficiency in programming languages such as Python, Java, or Scala.
· Proficiency in writing SQL for databases\
· Familiarity with building and using CI/CD pipelines.
· Familiarity with DevOps tools such as Docker, Git, Terraform.
Preferred requirements:
· Experience in designing, building, and maintaining batch and real-time data pipelines.
· Experience with Databricks.
· Experience with implementing technical processes to enforce data security, data quality, and data governance.
· Familiarity with government systems and government's policies relating to data governance, data management, data infrastructure, and data security.
JJ Consulting Services
EA Licence No.: 12C6207
Applicants are invited to send in a MS Word resume to [email protected] stating position applying for/present/expected salaries and earliest available date.
We thank all applicants in advance and regret that only short listed candidates will be notified.
