Research Fellow/Engineer (LEARN) - DS

As a University of Applied Learning, SIT works closely with industry in our research pursuits. Our research staff will have the opportunity to be equipped with applied research skill sets that are relevant to industry demands while working on research projects in SIT.

The project is an oral language proficiency evaluation on primary students. Specifically, the project is to provide an automatic interface to help primary students practice and improve in their mother tongue learning.

The primary responsibility of this role is to contribute to the delivery of an interactive multilingual language learning system. The role will be part of the research and development team to implement an automatic visual dialogue engine based on image understanding that complements the speech evaluation application to promote mother tongue learning for students.

Candidates should have work experience in computer vision, image understanding, object segmentation , and a good knowledge of general machine learning, especially neural networks. Candidates with work experience in computer vision applications including visual question and answer generation will be advantageous, however training will be provided.

Key Responsibilities:

• Participate in and manage the research project with Principal Investigator (PI), Co-PI and the research team members to ensure all project deliverables are met.
• Undertake these responsibilities in the project:
  1. Help in data collection.
  2. Data preprocessing.
  3. Object Segmentation
  4. Image to text
  5. Text Summarization
  6. Question and Answering Tasks
  7. Machine learning model deployment
• Training will be provided.

Job Requirements:

• Good command of programming in any programming languages.
• Degree in EE, CS or related areas, preferably with good knowledge in computer vision
• Good understanding and application experience of machine learning algorithms
• Familiar with image understanding and object segmentation under the end-to-end framework will be advantageous.
• Familiar with one or more of the open-source tools such as Kaldi, Tensorflow, Pytorch will be advantageous.
• Experience in image processing, opencv, multimodel large language models, image to text models, speech processing and natural language processing or other related algorithms will be advantageous.