Role Overview:
We are seeking an experienced Data Engineer to join our team, tasked with designing and implementing robust data pipelines, ensuring seamless data integration, and maintaining data infrastructure. This role involves close collaboration with business users and IT teams to transform data requirements into actionable technical solutions. You will oversee database performance, implement data governance and security policies, and introduce innovative technologies to optimize our data systems.
Key Responsibilities:
- Translate business data needs into technical specifications and project requirements.
- Collaborate with external IT teams to align infrastructure, security, and technology stacks.
- Design and implement scalable ingestion pipelines to collect, clean, merge, and harmonize data from multiple sources.
- Monitor and maintain databases and ETL systems, including capacity planning, performance tuning, and resolving any system issues.
- Build reusable data models that cater to end users' analytical and operational needs.
- Develop and maintain secure access mechanisms to the data warehouse for both systems and end users.
- Research and propose new technologies and processes to improve the overall data infrastructure and efficiency.
- Work alongside data stewards to establish data governance policies and ensure best practices are followed.
- Maintain a comprehensive data catalog documenting data assets, metadata, and lineage.
- Implement rigorous data quality checks and validation processes to ensure data accuracy.
- Enforce security standards including access control, encryption, and data masking to safeguard sensitive data.
Required Skills and Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or related fields.
- Strong knowledge of system design, data structures, algorithms, data modeling, and database management.
- Proven experience working with cloud platforms (AWS, Azure, or Google Cloud).
- Hands-on experience in designing and architecting IT systems and data infrastructure.
- Proficiency with orchestration frameworks (e.g., Airflow, Azure Data Factory) and distributed data technologies (e.g., Spark, Hadoop).
- Skilled in programming languages such as Python, Java, or Scala.
- Expertise in writing SQL queries for database management and analysis.
- Familiarity with CI/CD pipelines and DevOps tools such as Docker, Git, and Terraform.
Preferred Experience:
- Experience in building and maintaining both batch and real-time data pipelines.
- Knowledge of Databricks.
- Experience implementing security measures, data governance, and data quality processes.
- Familiarity with government systems and policies around data governance, management, and security.
To Apply:
Please send your latest CV in word file to [email protected]
Kindly indicate your availability, current and expected remuneration package.
We regret that only shortlisted candidates will be notified.
For more job opportunities, please visit our career page: http://quinnox-solutions.com/c...
Quinnox Solutions Pte Ltd (License Number: 06C3126)
Registered EA Personnel (Reg. No.R21103082)
