VibeCodeCareers 
This is a fully remote, mid-level role with Vals AI, a company focused on evaluating AI systems in clinical settings. The position involves using clinical expertise to assess AI interactions in mental health scenarios, identifying safety risks, and defining appropriate AI behavior.
Skills / Requirements
- AI Evaluation
- AI Safety
- Clinical Assessment
- Clinical Judgment
- Clinical Rating Systems
- Confidentiality
- Crisis Response
- Feedback Provision
- Mental Health Content Review
- Psychopathology
- Risk Evaluation
- Scenario Creation
- Vibe Coding
Why Apply
This role is ideal for those familiar with AI or digital mental health systems, as it involves reviewing AI conversations for safety and quality. You'll work with AI researchers and engineers, applying clinical judgment to improve AI responses in sensitive contexts.
What You'll Be Doing
You will review AI conversations to ensure clinical safety and appropriateness, identify risks, and provide feedback on AI behavior. You'll also help develop evaluation criteria and participate in review sessions with the research team.
Pay and Career Growth
Vals AI offers a flexible, part-time contract role, ideal for clinicians looking to transition into AI evaluation without needing a PhD. The company is well-funded, with a recent $40M Series A, indicating strong growth potential and industry impact.
Benefits and Perks
- competitive salary
- Flexible schedule
- Part-time
- Professional Growth
Is This Role Right for You?
Good fit if you...
- Clinicians with experience in mental health settings.
- Professionals comfortable with reviewing sensitive content.
- Individuals interested in applying clinical skills to AI safety.
May not be for you if...
- Candidates without clinical mental health credentials.
- Individuals uncomfortable with remote work.
- Those lacking interest in AI or digital mental health systems.
Original Job Description
About the Role
We’re looking for a Clinical AI Safety Contractor to help evaluate how AI systems respond in mental health and other clinically sensitive situations.
You’ll bring clinical judgment to reviewing AI conversations, identifying safety risks, and helping define what appropriate model behavior looks like. This is a flexible, part-time role for clinicians interested in applying their expertise to AI safety and evaluation.
What You’ll Do
Review and rate AI conversations for clinical safety, appropriateness, and quality
Identify clinically meaningful risks and model failure modes
Help create realistic scenarios, evaluation criteria, and scoring rubrics
Provide expert feedback on how AI should respond in sensitive situations
Participate in calibration and review sessions with researchers and engineers
Document important edge cases and emerging risks
Requirements
Clinical training and professional credentials are required, such as LCSW/LICSW, LMFT, LPC/LPCC/LCPC, clinical psychologist, psychiatrist, MD/DO, or comparable clinical mental health credentials
Experience working directly with patients or clients in a mental health setting
Strong grounding in clinical assessment, psychopathology, risk evaluation, or crisis response
Strong written communication and clinical judgment
Comfort reviewing sensitive mental health content and maintaining strict confidentiality
No PhD or prior AI experience is required.
Nice to Have
Experience with crisis intervention, suicide or self-harm assessment, or safety planning
Experience in adolescent mental health, psychosis, eating disorders, trauma, or other clinically complex areas
Experience developing clinical rating systems, assessment criteria, or coding frameworks
Familiarity with AI, digital mental health, trust & safety, or conversational systems
About us
Vals AI builds rigorous evaluations and benchmarks for frontier AI systems. Our work started from NLP evaluation research at Stanford, and today we work across technical and domain-specific areas, including healthcare and mental health. We raised a $5M seed and our team has backgrounds at Stanford, NVIDIA, Meta, Microsoft, Palantir, HRT, Jane Street, and Snorkel.
We recently announced our $40M Series A at a $400M valuation, led by Andreessen Horowitz, with participation from existing investors 8VC, Pear VC, and Bloomberg and new investors Hudson River Trading and NextLadder Ventures.
Vals in the Media:
AI tools mostly fumble basic financial tasks, study finds
The Winners (and Losers) of This New Vibe-Coding Benchmark Will Surprise You
OpenAI’s Less-Flashy Rival Might Have a Better Business Model
Meta Announces New AI Model in Major Test of Company’s Ambitions
DeepSeek’s Sequel Set to Extend China’s Reach in Open-Source A.I.
