Job Title: Data Engineer
Location: Tai Seng, Singapore
Job Type: Full-Time
Overview:
We are looking for a fresh graduate (degree or diploma) Data Engineer to join our growing team. In this role, you will design, build, and maintain data pipelines and infrastructure to support the collection, storage, and analysis of large volumes of data. The ideal candidate will have studied data engineering, cloud technologies, and have knowledge at optimizing data systems for performance and scalability. This position plays an important supporting role to our engineering team.
Key Responsibilities:
- Data Pipeline Development:
- Design, construct, and maintain scalable data pipelines that facilitate the extraction, transformation, and loading (ETL) of data from multiple sources.
- Optimize data pipelines to ensure high availability, performance, and data accuracy.
- Automate data workflows to streamline data processes and reduce manual interventions.
- Data Infrastructure Management:
- Develop, implement, and manage large-scale data processing systems using modern cloud platforms (e.g., AWS, Azure, Google Cloud).
- Design and implement scalable data storage solutions such as data lakes, data warehouses, and databases (e.g., Redshift, Snowflake, BigQuery).
- Monitor data systems for performance and scalability, making necessary improvements to infrastructure.
- Collaboration with Stakeholders:
- Work closely with data analysts, data scientists, and business teams to understand data requirements and deliver solutions that meet their needs.
- Collaborate with software engineers and IT teams to integrate data systems with existing applications and services.
- Ensure data architecture is aligned with the overall business strategy and technical environment.
- Data Governance and Security:
- Ensure data quality and reliability by implementing data validation, cleansing, and integrity checks throughout the pipeline.
- Enforce data security best practices, ensuring that sensitive data is appropriately protected and compliant with regulations.
- Implement data governance policies to manage metadata, data lineage, and access controls.
- Performance Optimization:
- Analyze and optimize query performance on large datasets, ensuring fast data retrieval and minimizing costs.
- Implement monitoring and logging to identify bottlenecks and optimize resource usage.
- Continuous Improvement:
- Stay current with emerging data engineering technologies and techniques to keep systems at the cutting edge.
- Continuously explore new ways to improve data architectures, pipelines, and processes to enhance efficiency and scalability.
Qualifications:
- Fresh graduates with Bachelor’s degree or Diploma in Computer Science, Information Technology, or a related field (or equivalent work experience).
- Proven experience as a Data Engineer or in a similar role, working with large-scale data systems.
- Strong proficiency in SQL, Python, or other programming languages used in data processing.
- Knowledge with cloud-based platforms and services (e.g., AWS, Azure, Google Cloud).
- Familiarity with distributed data processing frameworks such as Apache Spark, Hadoop, or Kafka.
- Knowledge with data warehousing and ETL tools (e.g., Snowflake, Redshift, Airflow, DBT).
- Strong understanding of database systems, both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra).
- Knowledge of data modeling, data architecture, and data governance practices.
Preferred Skills:
- Knowledge with machine learning pipelines or real-time data processing.
- Familiarity with DevOps practices and CI/CD pipelines for data engineering.
- Knowledge with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Strong problem-solving skills and the ability to work in a fast-paced, dynamic environment.
Benefits:
- Competitive salary and bonus structure.
- Opportunities for professional development and certification.
Application Process:
If you are passionate about building data systems that support impactful business decisions, we encourage you to apply. Please submit your resume and cover letter to [[email protected]].
