Medical Experts for AI Research Projects (Remote, US)

About the role

Mentis AI is seeking licensed US physicians and medical specialists to join a flexible, fully‑remote community of clinical experts. You will collaborate with leading AI labs to shape how artificial intelligence interprets real‑world clinical interactions, from notes to imaging, influencing tools used by healthcare professionals and patients.

Key responsibilities

• Review and label clinical notes, audio, video, and imaging data according to detailed guidelines.
• Conduct human‑in‑the‑loop evaluations of large language models (LLMs) for accuracy, safety, and clinical relevance.
• Design, test, and iterate prompts to improve model performance (prompt engineering).
• Create high‑quality instruction‑response pairs and explore edge‑case datasets for fine‑tuning AI models.
• Identify failure points, perform error analysis, and propose mitigation strategies.
• Develop and refine scoring rubrics for quality assurance (accuracy, clarity, safety, completeness).
• Collaborate with researchers to improve annotation standards and evaluation protocols.

Required profile

• Active medical license to practice in the United States.
• Native or near‑native fluency in English, both spoken and written.

Required skills

• Clinical data annotation and curation.
• LLM evaluation and performance testing.
• Prompt engineering for AI models.