Silverstone – Linguistic and LLM Evaluator and Annotator
/
/
Overview
This project will consist of three different approaches that we will call “workflows”:
Workflow 1: In this workflow, you will evaluate translation quality automatically generated, assigning grades from 0 to 6, in compliance with the instructions provided.
Workflow 2: In this workflow, you will annotate errors by selecting spans of words with their corresponding issue type and severities.
Workflow 3: In this workflow, you will be evaluating and/or choosing if the responses generated by a LLM are accurate and appropriate.
Purpose
This project is aimed at improving LLM engines, so that they can provide more accurate answers to the queries generated by users.
Main Requirements
Native French (Canada) / Italian (Italy) Speakers who are fluent in English
You can be based anywhere in the world but not in the following countries: Argentina, Bolivia, Brazil, Chile, Colombia, Ecuador, Mexico, Panama, United Kingdom, Venezuela, Russia.
Need to pass the required certifications.
Job Details
Location: Remote Type: Ongoing Salary: Fixed rate per hour
About OneForma
OneForma is part of Centific, a global digital and technology services company. We bring together data, intelligence, and experiences to deliver human-centric solutions to complex business challenges.
OneForma and Centific are an equal opportunity employer and will not discriminate against any of our applicants on the grounds of race, gender, religion, or cultural background.
