QA/Test Engineer - Fully Remote | Upto $90/hr
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: QA/Test Engineer
Type: Contract
Compensation: $60โ$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
- Design test cases to confirm each task works as intended, including tricky edge cases.
- Review tasks and reference solutions to catch ambiguity and gaps early.
- Debug using Python when tasks or checks don't behave as expected.
- Shape quality checklists and provide actionable feedback to authors.
- Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs.
Qualifications
Must-Have
- MSc or PhD in a STEM field or equivalent practical experience.
- 1+ years in test engineering, quality assurance, or a research/software engineering role.
- Skill in designing test cases, quality-review processes, and debugging complex systems.
- Proficiency in Python and Git .
- Exceptional attention to detail and clear documentation habits.
Preferred
- Experience in AI training , model evaluation, or quality review of AI-generated work.
- A perfectionist mindset with creativity in identifying overlooked issues.
Application Process (Takes 20โ30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas