Find Your Dream Job With Us
WE ARE HIRING !! Apply now and make a difference.
Job Title: Data Engineer (Spark Scala DevOps)
Role: Developer
Job Requisition Number: JR28211, JR28212
Job Level: 1 - 9 years of relevant experience (L1 - L3)
Location: Singapore
Job Objectives
We are seeking a skilled and motivated Data Engineer with expertise in Hadoop, Spark, OpenShift Container Platform (OCP), and DevOps practices. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines, processing large-scale datasets. Your expertise in Hadoop, Spark, OCP, and DevOps will be crucial in ensuring the availability, scalability, and reliability of our ML Solutions.
Key Responsibilities
l Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives
l Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions
l Ensure data quality and integrity throughout the data processing lifecycle
l Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques
l Optimize data engineering workflows for containerized deployment and efficient resource utilization
l Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability
l Implement data governance practices, data lineage, and metadata management to ensure data accuracy, traceability, and compliance
l Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements
l Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure
l Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference
l Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps
l Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank
Key Requirements
l Bachelor's degree in Computer Science, Information Technology, or a related field
l Proven experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments
l Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Pig, etc)
l Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes
l Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java
l Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
l Experience with Graphana, Prometheus, Splunk will be an added benefit
l Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges
l Excellent collaboration and communication skills to work effectively with cross-functional teams
l Ability to manage multiple priorities, meet deadlines, and deliver high-quality results in a fast-paced environment
l Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services is a plus
Please forward your resume in MS word format to [email protected] and [email protected]
Please refer your friends for any IT openings as we have various positions.
Please do not send PDF Format Resume . Send the following details
1. Notice period
2. Current Salary
3. Expected Salary
4. Visa Status in Singapore
5. Current Location
