We are seeking an experienced Data Engineer with a strong background in Hadoop, Spark, and SQL, specifically within the banking sector. The ideal candidate will be responsible for designing, building, and maintaining large-scale data pipelines and platforms to support critical banking applications and decision-making processes.
Key Responsibilities:
- Data Pipeline Development: Design, develop, and maintain efficient data pipelines and workflows using Hadoop and Spark frameworks to support the bank’s data processing needs.
- Data Integration & ETL: Create ETL processes to extract, transform, and load large datasets into Hadoop ecosystems from various banking systems, ensuring data consistency and accuracy.
- Database Management: Write optimized SQL queries to manage and analyze data stored across relational databases, data lakes, and cloud platforms.
- Data Processing & Analysis: Implement scalable data processing solutions to analyze large datasets, provide insights, and deliver solutions for financial services and risk management.
- Collaboration: Work closely with business analysts, data scientists, and IT teams to ensure data solutions align with banking sector needs, including compliance with regulations and reporting requirements.
- Performance Optimization: Fine-tune Hadoop and Spark applications for performance, improving throughput and reducing latency.
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
- Strong years experience as a Data Engineer, specifically within the banking or financial sector.
- Proficiency in Hadoop ecosystem tools (HDFS, Hive, HBase) and Spark for large-scale data processing.
- Strong experience with SQL and relational databases such as PostgreSQL, MySQL, or Oracle.
- Familiarity with cloud platforms (AWS, Azure) and containerization tools (Docker, Kubernetes) is a plus.
- Experience in data governance and compliance regulations within the financial industry.
- Excellent problem-solving and analytical skills.
- Salary: SGD 6000 - 9500
- Great Work Culture
- Includes comprehensive insurance for self and family. Includes Specialist and Dental Coverage.
- Includes Standard Annual and Sick Leave
