Remote Data Labeling Specialist (India)

Remote Data Labeling Jobs in India Rex.zone is hiring a Remote Data Labeling Specialist to create and validate labeled training data for AI/ML systems, including LLM evaluation workflows. You will follow detailed annotation guidelines, document edge cases, and collaborate with QA reviewers to improve training data quality and downstream model performance.

What You Will Do

• Label and review text, image, and multimodal data for AI/ML use cases
• Perform RLHF-style preference ranking and prompt evaluation for large language model evaluation
• Execute QA evaluation checks, resolve disagreements, and reduce annotation variance
• Maintain annotation guidelines compliance and escalate ambiguous policy edge cases
• Contribute to training data quality metrics (accuracy vs. gold sets, audits, inter-annotator agreement)
• Collaborate asynchronously with project leads across AI labs, tech startups, BPO teams, and annotation vendors

Key Workflows

• NLP: classification, intent, named entity recognition, entity linking, taxonomy tagging
• Computer Vision: bounding boxes, polygons, keypoints, segmentation masks, OCR tagging
• Content Safety: policy-based labeling, moderation categories, sensitive attributes handling
• LLM Evaluation: response grading, hallucination checks, factuality review, safety alignment, RLHF ranking
• Quality Systems: gold-set calibration, audit sampling, error taxonomy

Requirements

• Mid-to-senior experience in data labeling/data annotation with measurable QA outcomes
• Strong English reading comprehension and careful instruction-following for rubric-based evaluation
• Comfort with annotation tools, task queues, and remote QA workflows
• Ability to apply consistent labeling decisions and document edge cases clearly

Compensation Competitive hourly rate: $30–$50 per hour (based on skills and program needs).