AI Assessment Specialist - PhD

๐Ÿข mercor ยท all mercor jobs
๐Ÿ“ Germany
๐Ÿ“… Posted 2026-08-15 ยท via Himalayas
๐Ÿท Technical-Assessment-Specialist,AI-Assessment-Specialist,Computer-Science-Specialist,Benchmark-Content-Developer,Assessment-Question-Writer,AI-Evaluation-Specialist,AI-Assessment-Jobs,AI-Testing-Specialist,AI-ML-Evaluation-Specialist,Assessment-Scientist,AI-Assessor,AI-Model-Evaluation-Specialist,Assessment-Specialist,AI-Evaluation-Analyst
Apply on original site โ†—

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Applied Computer Science Benchmark Specialist
Type: Contract
Compensation: $66โ€“$84/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities

- Author original computer science questions that test deep conceptual understanding.

- Ensure questions are unambiguous, self-contained, and precisely defined.

- Rate each question's difficulty as Medium, Hard, or Expert.

- Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.

- Write step-by-step Chain-of-Thought solutions in markdown format.

- Supply 1โ€“5 academic references per question from reputable sources.

- For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Qualifications

Must-Have

- PhD or doctoral candidate in Computer Science , Electrical Engineering , or a closely related field.

- Master's degree considered for candidates with exceptional depth in a specific subdomain.

- Strong command of graduate-level CS theory , algorithms , systems design , and/or machine learning .

- Excellent written English and ability to express complex ideas clearly and concisely.

Preferred
- Research publications, industry experience at top tech companies, or competitive programming background.

Application Process (Takes 20โ€“30 mins to complete)

- Upload resume

- AI interview based on your resume

- Submit form

Resources & Support

- For details about the interview process and platform information, please check:

- For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas

โ† All remote jobs