Legal Subject Matter Expert (AI Evaluation) – Remote Contractor

About the role

Turing is seeking an experienced legal professional to help evaluate and improve AI systems that handle legal research, contracts, litigation workflows, and operations. This fully remote, four‑week contractor assignment will focus on creating realistic legal scenarios and assessing AI‑generated outputs for accuracy and compliance.

Key responsibilities

• Create legal workflow prompts and synthetic case/contract scenarios for AI testing.
• Evaluate AI‑generated legal reasoning, citations, and workflow outputs.
• Identify edge cases such as missed deadlines, hallucinated citations, contract conflicts, and billing discrepancies.
• Develop evaluation rubrics and expert reasoning traces to guide model improvement.

Required profile

• 4–9+ years of experience in legal research, litigation, contracts, legal operations, or legal systems.
• Strong familiarity with LexisNexis, Litify, DocuSign, and/or NetDocuments.
• Excellent legal writing and analytical abilities.
• Experience with AI tools such as ChatGPT or Claude.
• JD, paralegal certification, or legal ops experience preferred; AI evaluation or RLHF experience is a plus.

Required skills

• LexisNexis
• Litify
• DocuSign
• NetDocuments
• ChatGPT
• Claude
• Clio (optional)
• Westlaw (optional)
• Relativity (optional)
• Ironclad (optional)
• iManage (optional)

What we offer

• Fully remote work with a 40‑hour week and a 4‑hour PST overlap.
• Contractor assignment (no medical/paid leave) for a 4‑week period, starting next week.