AI Evaluator – Multilingual

Job Description: AI Evaluator – Multilingual

Location: Singapore

Engagement Type: Freelance / Contract

Language Requirements: Native proficiency in any one of the following languages: Mandarin Chinese, Malay, Tamil, Hindi, or Bengali.

Job Overview

We are looking for detail-oriented AI Evaluators with experience or exposure to AI tools, prompt evaluation, and AI-generated content review. The role involves evaluating AI-generated responses, reviewing prompts, and assessing the accuracy, relevance, quality, and linguistic appropriateness of AI outputs in the candidate’s native language.

Key Responsibilities

• Review and evaluate AI prompts, responses, and generated content.
• Assess AI-generated outputs for accuracy, relevance, clarity, and instruction-following.
• Identify errors, inconsistencies, misleading information, and language-related issues.
• Compare responses generated by different AI models and determine which provides better results.
• Evaluate the quality of AI responses in the assigned native language.
• Provide structured feedback and ratings based on defined evaluation guidelines.
• Follow project instructions and quality standards while maintaining consistency in evaluations.

Required Skills

• Proficiency in Mandarin Chinese, Malay, Tamil, Hindi, or Bengali .
• Experience or exposure to AI tools, generative AI platforms, prompt engineering, or AI-generated content review.
• Good understanding of prompts, instructions, and AI-generated responses.
• Strong analytical, comprehension, and critical-thinking skills.
• Excellent attention to detail and ability to identify errors in content.
• Basic to good English communication skills to understand project guidelines and evaluation instructions.

Preferred Qualifications

• Experience in AI evaluation, LLM evaluation, data annotation, content moderation, linguistic quality assessment, or similar projects.
• Familiarity with AI tools such as ChatGPT, Gemini, Claude, or similar generative AI platforms.
• Ability to compare multiple AI-generated responses and evaluate their quality objectively.

Ideal Candidate Profile

Candidates with a background in language, linguistics, content writing, translation, data annotation, or technology-related fields are encouraged to apply, provided they have relevant AI tool exposure and native-level proficiency in one of the required languages.

Interested candidates: Please share your updated resume highlighting your language proficiency and any experience or exposure to AI tools, prompt evaluation, or AI-generated content review.