Bilingual Evaluator - Fully Remote | Upto $50/hr

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Dutch Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Duration: 3–6 months
Role Responsibilities

- Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions.

- Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English .

- Conduct model testing by running prompts and assessing outputs against expectations.

- Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.

- Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Qualifications

Must-Have

- Strong writing and critical thinking skills

- Ability to work independently and meet deadlines

- Fluent in Dutch and English

- Able to work within GMT or PST working hours

Preferred
- College students or graduates

Application Process (Takes 20–30 mins to complete)

- Complete an AI-led interview (approximately 15 minutes)

- If selected, you will be invited to work on the project

Resources & Support

- For details about the interview process and platform information, please check:

- For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas