Analytical Evaluator - AI Feedback

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities - Evaluate AI-generated responses to ensure accuracy and depth in reasoning. - Provide structured written feedback to improve AI model outputs . - Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content . - Write clear, precise, and well-evidenced rationales beyond surface-level observations. - Work independently and asynchronously to meet deadlines and improve AI model performance . Qualifications Must-Have - Bachelor's degree from a top-500 globally ranked university preferred. - Strong analytical and written communication skills. - Ability to work independently and follow detailed task guidelines. - Strong critical reading skills. - Native English fluency required. Preferred - None specified. Application Process (Takes 20–30 mins to complete) - Upload resume - AI interview based on your resume - Submit form Resources & Support - For details about the interview process and platform information, please check: - For any help or support, reach out to: PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. Originally posted on Himalayas