AI Evaluation Specialist – Analytical Review & Structured Feedback

About the role

We are looking for an AI Evaluation Specialist to assess the quality of AI‑generated responses. You will work remotely, applying rigorous analytical methods to ensure outputs are accurate, logical, and clearly articulated.

Key responsibilities

• Evaluate AI‑generated answers for correctness, reasoning depth, and clarity.
• Provide detailed, structured written feedback for each evaluated response.
• Identify logical gaps, implicit assumptions, and reasoning flaws.
• Apply standardized evaluation guidelines consistently across diverse tasks.
• Document evidence‑based rationales that go beyond surface‑level observations.

Required profile

• Bachelor’s degree preferred, preferably from a top‑ranked university.
• Strong analytical thinking and critical reading abilities.
• Excellent written communication with precise reasoning.
• Ability to spot nuanced issues in complex answers.
• High attention to detail and consistency in evaluations.
• Self‑motivated, able to work independently following structured guidelines.
• Native‑level English proficiency.
• Commitment to complete tasks without using AI writing tools.

Required skills

What we offer

• Hourly contract with flexible part‑time or full‑time commitment.
• Compensation ranging from $60 to $200 per hour.
• Fully remote work environment.