Confidential company
LLM Response Evaluator
AI Evaluator Remote Contract $22 - $40 / hour
Apply through RemoteAIJobs You'll be redirected to the hiring company. Return and mark “I Applied” when done.
Compare and rate model outputs against detailed rubrics to improve helpfulness, accuracy and safety.
Evaluate side-by-side model responses and score them against a rubric covering factual accuracy, instruction following, tone and safety.
You will flag hallucinations, unsafe completions and subtle instruction violations, then write a short justification for each rating. Calibration sessions keep the whole reviewer pool consistent.
Fully remote and asynchronous — no fixed meetings, no timezone requirement.
Requirements
- Careful attention to detail and consistent judgement
- Ability to explain a rating in two or three clear sentences
- Willingness to follow evolving rubrics precisely
- No prior AI experience required; onboarding is provided
evaluationrlhfremoteentry level