JOB DESCRIPTION
At Keppel, data drives our decisions. Technology is at our core. And innovation is everywhere.
Keppel is looking for a data-savvy professional to join our team. As a Senior Data Engineer, you will be working with partners throughout the company to ensure we have high-quality data to power our business in all departments. Decisions for every part of our business -- from the front-end experience to performance marketing to partner products -- are driven by our data via various enterprise apps. Your challenge will be to make sure we can apply our data even more effectively to support business decisions and improve our products. You Will Be Part of The Data & Digital Team.
Responsibilities
As a Senior Data Engineer, you will be in charge of the development, performance, quality, and scaling of our data pipelines, with a special focus on data quality. You will work independently and will also be responsible for making technical decisions within a team.
Important Aspects of The Job Include
- Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
- Supporting the legacy systems while we build the next gen Data Ecosystems to support the business.
- Solving issues with data and data pipelines, prioritizing based on customer impact.
- End-to-end ownership of data quality in our core datasets and data pipelines.
- Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality.
- Providing tools that improve Data Quality company wide.
- Providing self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.
- Acting as an intermediary for problems, with both technical and non-technical audiences.
JOB REQUIREMENTS
We are looking for driven Data Engineers who enjoy solving issues, who initiate solutions and discussions, and who believe that any challenge can be scaled with the right demeanor and tools.
The ones that fit us best are the people who match the following requirements:
- Proven experience of at least 5 years in the field, using 1 or more server-side programming languages -- preferably Java, Scala, Python, Perl, etc.
- Proven experience of minimum 5 years with SQL, HQL, CQL, etc.
- Experience with building scalable data pipelines with technologies such as Glue, ADF, Kafka, Spark, HBase, AzureSQL, DBT etc.
- Strong Experience in Data Modeling, Data warehousing / ETL tools
- Experience using Snowflake & DBT is a plus
- Experience with a cloud platform (AWS, Azure)
- Understands and can develop streaming processing applications using technologies like Kafka-Streams, Spark-Streaming, etc.
- Experience of working on systems on large scale.
- Good understanding of basic analytics and machine learning concepts.
- Preferably a university degree in Computer Science.
- Excellent communication, written and spoken.
