LLM Evaluation

Overview

Job Type: Ongoing

Salary: Fixed rate per hour

Description

For this project, we are seeking US-based native Hindi speakers, with a linguistic background and a deep understanding of both Western and Hindu cultures.

Main Duties

• Content Creation/Writing:
  - Creating/writing prompts and responses in Hindi that are culturally aligned with Hindu perspectives and contrast with Western culture.

• Content Evaluation:
  - Evaluating Hindi prompts & responses based on several culturally relevant parameters such as:
  - Sensitivity
  - Local stereotypes
  - Food/buying habits
  - Tone
  - Abbreviations
  - Vocabulary
  - Accent
  - Phrasing

Purpose

The aim of this task is to improve AI technologies, enabling them to create culturally relevant content.

Requirements

• Native Hindi speakers with fluent English

• Residency in the US for a reasonable duration

• LLM authoring and evaluation experience is valued

• Completion of required certifications

• Willingness to work at least 4-5 hours a day (full-time availability preferred)