LLM QA Contractor

Position:
LLM QA Contractor (Part-Time | Remote | Freelance)

Company:
Alongside

Location:
India

Employment type:
Part-Time, Freelance

Work Arrangement:
Remote

Short Summary:
We are looking for a detail-oriented LLM QA Contractor to join an AI validation project focused on improving the quality of Large Language Model (LLM) outputs.

Responsibilities:
- Review AI-generated outputs against source images and delivery instructions.
- Verify factual accuracy, completeness, and adherence to annotation guidelines.
- Identify and classify issues such as hallucinations, missing information, incorrect interpretations, or policy violations.
- Provide concise and structured feedback to support continuous model improvement.
- Follow detailed Standard Operating Procedures (SOPs) and participate in calibration sessions.
- Track your work using annotation tools and spreadsheets.
- Escalate ambiguous cases or guideline gaps when needed.
- Consistently meet quality, accuracy, and productivity targets.

Requirement:
- Excellent attention to detail and a structured, analytical mindset.
- Previous experience in Content QA, Data Labeling, Trust & Safety, Content Moderation, or similar quality assurance roles.
- Strong visual analysis and reading comprehension skills.
- Comfortable working with web-based tools, spreadsheets, and annotation platforms.
- Reliable, organized, and able to handle repetitive tasks while maintaining a high level of accuracy.
- Strong written communication skills in English.
- Able to handle confidential and user-generated content responsibly.

Benefits:
- Remote: Work from anywhere.
- Contract: Freelance / Service Agreement.
- Initial duration: 90-day contract with the possibility of extension.
- Schedule: Part-time (4 hours per day).
- Weekly workload: The project has two main work peaks each week, on Mondays and Wednesdays.
- Critical requirement: Every batch of photos must be reviewed within 36 hours.
- Availability: No need to work during Portugal business hours; only 1 hour of overlap is required for a brief team status update on Monday and Wednesday afternoons (Vietnam time).
- Rate: USD 4-5/hour.