Remote Quality Analyst – AI Evaluation

About the role

Hire Feed is seeking a Remote Quality Analyst to evaluate and improve advanced AI systems. The role focuses on assessing AI‑generated responses, testing personalization features, and delivering detailed feedback to enhance model performance.

Key responsibilities

• Evaluate the quality and relevance of personalized AI‑generated responses.
• Create multi‑turn prompts to test AI models and personalization capabilities.
• Analyze AI outputs for accuracy, grounding, helpfulness, and proper information integration.
• Review side‑by‑side AI response comparisons to identify differences in quality.
• Provide detailed feedback to improve AI model performance.
• Identify incorrect personalization, inconsistencies, and suggest improvements.
• Support ongoing AI evaluation projects and quality‑improvement initiatives.

Required profile

• Strong English proficiency with excellent reading and writing skills.
• Experience in prompt engineering or designing test cases for AI models.
• Ability to analyze complex and ambiguous AI responses.
• Familiarity with AI personalization concepts and evaluation metrics.
• Strong attention to detail and analytical thinking.
• Willingness to use a primary Google account for assessment purposes.
• Availability to work full‑time in your local time zone as part of a global 24‑hour operations team.

Required skills

• Prompt engineering
• AI model testing
• Data analysis

What we offer

• Competitive salary range of $60,000–$90,000 per year.
• Fully remote work arrangement within the United States.
• Opportunity to contribute to cutting‑edge AI technology.