Morgan McKinley is looking for a skilled Machine Learning Engineer for a 12-months contract with our client in the tech industry.
As a Machine Learning Engineer within the ML Platform team, you will play a key role in developing frameworks and infrastructure for evaluating large language models (LLMs). Your focus will be on creating automated, repeatable evaluation processes and optimizing pipelines to ensure robust and efficient model assessments. The team is at the forefront of empowering teams across the organization to leverage the power of machine learning
Key Responsibilities:
- Design and Optimize LLM Evaluation Pipelines: Develop scalable pipelines to assess the performance of large language models, utilizing tools like Ray to enable efficient distribution of tasks.
- Develop Evaluation Metrics and Benchmarks: Create and integrate a comprehensive set of metrics and benchmarks to evaluate LLMs across various domains and tasks.
- Analyze and Communicate Results: Conduct detailed analyses of evaluation outcomes to identify model strengths, weaknesses, and areas for improvement, and present findings effectively to stakeholders.
- Collaborate Across Teams: Partner with research scientists and engineers to understand model requirements and implement effective evaluation strategies that align with their goals.
- Stay Updated on LLM Trends: Keep abreast of the latest advancements in LLM evaluation methodologies, tools, and best practices to ensure our processes remain cutting-edge.
Qualifications:
- With 2-3 years of experience in Machine Learning Engineering and Python
- Expertise in LLM Evaluation: A solid understanding of methodologies, metrics, and benchmarks for evaluating LLMs across tasks like text generation, summarization, and question answering.
- Proficiency in Distributed Computing: Hands-on experience with frameworks like Ray or similar technologies for scaling LLM evaluation processes.
- Strong Python and Machine Learning Skills: Advanced programming skills in Python and familiarity with machine learning libraries and tools.
- Experience with Kubernetes and Cloud Platforms: Proficiency in deploying and managing applications on Kubernetes, with a working knowledge of AWS.
- Strong interpersonal skills to work effectively with cross-functional teams and convey technical findings clearly.
Interested candidates may apply through the application system or send it to [email protected]. Shortlisted candidates will be notified.
By sending us your personal data and curriculum vitae (CV), you are deemed to consent to Morgan Mckinley Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.morganmckinley.com/sg/privacy-policy. You acknowledge that you have read, understood, and agree with the Privacy Policy.
Morgan McKinley Pte Ltd
Koh Boon Sien
EA Licence No: 11C5502
EA Registration No. R1110345
