AI Evaluator - Software Expert

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities

- Evaluate AI-generated artifacts against domain-specific quality rubrics.

- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .

- Provide clear, structured written feedback to improve AI model outputs .

- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.

- Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

- 5+ years of relevant professional experience in Software / AI / IT / data .

- Native or professional fluency in English .

- Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

- Upload resume

- AI interview based on your resume

- Submit form

Resources & Support

- For details about the interview process and platform information, please check:

- For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas