About the Client
Our client is one of the reputed MNC firms in Singapore
Responsibilities
• Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data
• Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data
• Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch
• Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions
• Implement data transformations, aggregations, and computations using Spark RDDs, DataFrames, and Datasets, and integrate them with Elasticsearch
• Develop and maintain scalable and fault-tolerant Spark applications, adhering to industry best practices and coding standards
• Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration
• Monitor and analyze job performance metrics, identify bottlenecks, and propose optimizations in both Spark and Elasticsearch components
• Stay updated with emerging trends and advancements in the big data technologies space to ensure continuous improvement and innovation
Skills/Requirement
Must have Skills:
• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
• Strong experience in developing Spark applications. Experience with Spark Streaming is a plus
• Proficiency in Scala programming language and familiarity with functional programming concepts
• In-depth understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL
• Experience integrating and working with Elasticsearch for data indexing and search applications
• Solid understanding of Elasticsearch data modeling, indexing strategies, and query optimization
• Experience with distributed computing, parallel processing, and working with large datasets
• Familiarity with big data technologies such as Hadoop, Hive, and HDFS
• Proficient in performance tuning and optimization techniques for Spark applications and Elasticsearch queries
• Strong problem-solving and analytical skills with the ability to debug and resolve complex issues
• Familiarity with version control systems (e.g., Git) and collaborative development workflows
• Excellent communication and teamwork skills with the ability to work effectively in cross-functional teams
Interested candidates, who wish to apply for the above position, please send in your resume to [email protected]
We regret to inform that only shortlisted candidates will be contacted.
PERSOLKELLY Singapore Pte Ltd
EA License No. 01C4394
EA Registration No. R1547247 (Jyothi Chandrakanth Kamath)
**********************************
The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.
By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOLKELLY Singapore Pte Ltd and its local and overseas subsidiaries and affiliates collecting, using and disclosing your personal data to prospective employers/companies based in any country for purposes of evaluating suitability for employment, conducting reference checks, administering employment related services and such other purposes stated in our privacy policy. Our full privacy policy is available at www.persolkelly.com.sg. If you wish to withdraw your consent, please drop us an emailto let us know. Please feel free to contact us if you have any queries.
All parties involved in any form of workforce engagement are to strictly adhere to prevailing regulations and laws that govern local fair employment practices, and to invest reasonable efforts in building a strong Singaporean core workforce, recruit and select candidates based on merit and prohibit discrimination based on age, race, gender, religion, marital status and family responsibility or disability. For more information, please refer to MOM and TAFEP websites.
**********************************
