We are looking for a highly skilled Data Engineer specializing in Data Quality to join our Data Platform Engineering team. In this role, you will be responsible for managing data quality (DQ) and data catalog platforms within the organisation. Your primary focus will be on building and maintaining DQ pipelines and ensuring data integrity and reliability.
Duties include:
- Work alongside the Data Platform Engineering team to develop and maintain data quality management systems.
- Build and maintain DQ pipelines to ensure data quality across various platforms.
- Develop templates and frameworks for data engineers to onboard their DQ rules effectively.
- Collaborate with Infra & Cloud Operations teams to ensure seamless integration and data flow.
- Provide recommendations on sizing and tuning jobs based on data volume and query complexity.
Ideal Qualifications
- Bachelor’s degree in computer science, Information Technology, or a related field.
- At least 5 years of experience as a platform engineer or software engineer.
- Strong analytical skills and attention to detail.
- Excellent communication and interpersonal skills to work with data analysts, business end-users, and vendors.
- Proficient in Python and Java.
- Strong knowledge of Unix shell scripting for automation and process management.
- Expertise in data quality profiling and familiarity with data quality tools.
- Proficient in writing and optimizing SQL queries.
- Experience with integrating various data pipelines.
- Familiarity with CI/CD tools, preferably GitHub.
- Experience with RestAPI development and integration.
- Knowledge of AWS cloud services.
- Experience with RDBMS integration, particularly with Snowflake, Oracle, and MS-SQL.
- Familiarity with application integration and efficient data structures and algorithms.
We regret to inform that only shortlisted candidates will be notified / contacted.
EA Registration No: R22105541, TAY ZHIHENG, DARIUS
Allegis Group Singapore Pte Ltd, Company Reg No. 200909448N, EA License No. 10C4544
