remotely.living

Clinical Mental Health Expert — AI Conversation Evaluation

Mercor · Remote - Worldwide · Contract · 2026-09-30

Apply for this job

Job description

Mercor is seeking **Clinical Mental Health Experts** to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a **short-term, fully remote evaluation task** designed for mental health professionals who can apply their clinical experience and professional judgment to assess realistic conversational scenarios. **The task will take up to 30 minutes to complete.**

## What You’ll Do

- Review pairs of simulated conversations involving clinical mental health scenarios.

- Evaluate the conversations based on their **realism and authenticity**.

- Determine which conversation more closely reflects a realistic clinical interaction.

- Apply your clinical experience and professional judgment when making evaluations.

- Complete the evaluation independently through an online interface.

## Ideal Background

We welcome professionals with a **relevant degree and clinical mental health expertise**. Suitable backgrounds may include:

- Clinical Psychology

- Counselling Psychology

- Mental Health Counselling

- Clinical Social Work

- Psychiatry

- Psychotherapy

- Behavioural Health

- Marriage and Family Therapy

- Other closely related clinical mental health disciplines

**Candidates should have:**

- A relevant degree or professional qualification in a mental health-related field.

- Practical experience working in a clinical mental health or behavioural health setting.

- Familiarity with real-world conversations between mental health professionals and patients or clients.

- Strong professional judgment and the ability to identify whether clinical interactions feel realistic and authentic.

- Strong attention to detail and the ability to make independent qualitative assessments.

## Why Join

- Apply your clinical expertise to the evaluation of advanced AI systems.

- Contribute to research aimed at improving the realism and quality of AI-generated interactions.

- Be considered for future AI evaluation and research opportunities requiring clinical mental health expertise.