Optimum Solutions (Registration Number: 199700895N) is Singapore's leading Information Technology , Consulting and Professional Services company with Competence in Digital Transformation, Automation, Robotics, Cloud, Big Data, Analytics and Emerging technologies projects. Optimum has been successfully delivering IT projects since 1997 and has been a key IT service provider to clients delivering Software Design, Development, Engineering and IT Transformation Projects.
Job Description/Requirements:-
- Write and maintain programmable code outlined in technical instructions and specifications for software applications and operating systems.
The candidate must have 08+ Years of IT working experience in the following areas:-
- Strong working experience in developing Hadoop/Spark for 5+ years
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
- Strong working experience in data lakes (integration of different data sources into the data lake) is a must.
- SQL Stored Procedures/Queries/Functions
- Unix Scripting and Data Architecture (Hadoop) is must
- Recent working experience in banking or Financial domain is a must.
- Solid understanding data modeling, indexing strategies, and query optimization
- Experience with distributed computing, parallel processing, and working with large datasets
- Familiarity with big data technologies such as Hadoop, Hive, and HDFS
- Job Scheduling in Control-M
- Strong problem-solving and analytical skills with the ability to debug and resolve complex issues
- Familiarity with version control systems (e.g., Git) and collaborative development workflows
Responsibilities:
Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data lake
Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data
Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch
Domain - Banking
