Primary Care Physician - AI Evaluator

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation
Type: Contract
Compensation: $170–$190/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities

- Review outpatient clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness.

- Evaluate AI-generated notes and summaries against what a practicing PCP would document.

- Annotate outpatient encounter data against detailed guidelines and flag omissions, hallucinations, and clinical inaccuracies.

- Provide structured, written feedback that engineering and product teams can act on to improve AI systems .

- Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions.

- Raise clarifying questions where guidance is ambiguous and help refine the guidelines.

Qualifications

Must-Have

- MD , with 2+ years post-residency , currently practicing primary care / family medicine / general internal medicine.

- US-based .

- Direct experience writing clinical notes in an outpatient setting .

- Minimum availability of 10 hours/week for the next 3 months .

Preferred

- 5+ years of experience post-residency.

- Familiarity with Epic .

- Experience with clinical documentation quality review, note auditing, or CDI exposure.

- Prior AI/ML annotation or model evaluation work experience, with strong performance reviews.

Application Process (Takes 20–30 mins to complete)

- Upload resume

- AI interview based on your resume

- Submit form

Resources & Support

- For details about the interview process and platform information, please check:

- For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas