AI Response Evaluation Analyst (Freelance)

iMerit Inc is assembling a global team of evaluators to improve AI models through careful human judgment. You'll review AI responses, decide which hold up, and write detailed rationales that feed directly into model improvement. **What you'll do:** • Review AI-generated responses across multiple domains and use cases • Rate and rank responses against defined quality criteria: accuracy, relevance, conciseness, safety, localization • Write short, detailed rationales for every ranking you submit • Interpret conversational context to identify what users really wanted • Compare multiple responses and explain why one is better than another • Verify factual claims using approved research sources • Flag tasks that cannot be reliably assessed rather than guessing • Work independently with flexibility on your schedule **What we're looking for:** • Strong critical thinking and sound judgment in ambiguous situations • Solid research skills and meticulous attention to detail • Excellent reading comprehension and analytical ability • Professional written English that is clear and concise • Self-direction and discipline to meet deadlines without supervision • Reliability and consistency in evaluating complex information **Nice-to-haves:** • Prior experience in AI evaluation or annotation work • Background in writing, editing, research, or translation • Familiarity with AI models and their limitations **What we offer:** • Independent contractor engagement • Fully remote and flexible—you choose your hours • Work on cutting-edge AI improvement projects • Task-based compensation • Paid qualification assessment before live work begins • Variable task volume based on project demand