Quality Analyst

WE’RE HIRING: Freelance QUALITY ANALYST – AI CHATBOT / LLM EVALUATION

Location: India

Experience: 3+ years

Budget: Rs. 1,30,000 to 164,000 Monthly (Depending on experience)

Availability: Full-time | 8 hours/day

Are you detail-oriented, analytical, and passionate about AI, chatbots, and data quality? This opportunity could be for you!

We’re looking for a Quality Analyst to evaluate and compare AI-generated responses, identify quality issues, and ensure outputs meet defined accuracy and quality standards.

Key Responsibilities

• Evaluate and compare responses generated by multiple chatbots.
• Assess accuracy, relevance, completeness, clarity, and adherence to guidelines.
• Identify inconsistencies, inaccuracies, missing information, and subtle errors.
• Provide structured feedback and clear evaluation outcomes.
• Maintain consistency and meet quality, productivity, and turnaround-time targets.
• Collaborate with project teams and escalate ambiguous cases when required.

Required Skills & Qualifications

• 3+ years of experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
• Strong analytical, critical-thinking, and problem-solving skills.
• Excellent written and verbal communication skills.
• High attention to detail and the ability to follow detailed guidelines.
• Comfort working with AI tools, chatbots, and online platforms.
• Ability to work independently and manage multiple tasks.

Good to Have

Experience in chatbot evaluation, LLM testing, Generative AI, AI response evaluation, or data-quality projects.

Work Schedule

• Full-time availability for 8 hours per day.
• Minimum 4 hours of overlap with the US Pacific Time (PST) zone.
• 5 working days per week, including weekends as required, with 2 weekdays off.

Pay: ₹130,000.00 per month

Benefits:

• Flexible schedule
• Work from home

Work Location: Remote