Tag

117 remote Ai Evaluator jobs

117 open remote Ai Evaluator roles from top companies and boards — updated hourly.

Bilingual Language Model Evaluatortoday

mercor·United States·USD 15 - 20 / hourly

bilingual-evaluatorlanguage-model-evaluatorai-evaluatordata-annotatorcontent-evaluatorbilingual-ai-evaluation

Data Evaluator - Fully Remote | Upto $120/hryesterday

mercor·Australia·USD 80 - 120 / hourly

ai-evaluatordata-evaluatorai-trainerai-quality-assuranceprompt-engineerdata-evaluation-analyst

Andromeda Sadiradra - Audio Rater - Generalist - English (United State)yesterday

Welo Global·United States·USD 26.33 / hourly

audio-raterai-evaluatorquality-assurance-raterai-content-revieweraudio-qa-annotation-specialist

Government Evaluator - Fully Remote | Upto $120/hryesterday

mercor·Canada·USD 80 - 120 / hourly

government-evaluatorpublic-administration-evaluatorai-evaluatorqa-specialistcontract-evaluator

LLM Model Response Evaluationyesterday

Lifted (an Upwork Company)·United States

ai-evaluatorllm-evaluatorai-trainercontent-evaluatorai-annotation-specialistai-response-evaluation

Copy of Dutch-Speaking JSON & Coding Experts for Audio Evaluationsyesterday

Lifted (an Upwork Company)·Belgium

ai-evaluatorconversational-ai-specialistlanguage-qa-specialistai-trainercontent-evaluatordutch-audio-data-collection-specialist

Compliance AI Evaluator - Financeyesterday

mercor·India·USD 80 - 120 / hourly

ai-evaluatorcompliance-analystai-quality-assurancecompliance-evaluatorai-compliance-evaluatorai-compliance-evaluation

AI Safety Practitioner - Expert Evaluatoryesterday

mercor·Denmark·USD 60 - 70 / hourly

ai-safety-specialistai-safety-practitionertrust-and-safety-analystai-evaluatorcontent-moderatorai-safety-evaluator

Compliance AI Evaluator - Financeyesterday

mercor·Canada·USD 80 - 120 / hourly

ai-evaluatorcompliance-evaluatorai-auditorfinancial-compliance-specialistqa-specialistai-compliance-evaluator

Experiment Readiness Specialist - Fully Remote | Upto $120/hryesterday

mercor·United States·USD 80 - 120 / hourly

ai-evaluatorcontent-evaluatorai-trainersubject-matter-expertquality-assurance-evaluatorexperiment-readiness-specialist

Financial Compliance AI Evaluatoryesterday

mercor·United States·USD 80 - 120 / hourly

ai-evaluatorcompliance-specialistcompliance-evaluatorregulatory-compliance-specialistqa-specialistai-compliance-evaluator

Chemical Safety Expert - Fully Remote | Upto $70/hr Part-timeyesterday

mercor·United States·USD 65 - 70 / hourly

chemistry-expertai-safety-specialistscientific-writerchemistry-consultingai-evaluatorchemical-safety-specialist

Andromeda Sadiradra - Audio Rater - Generalist - English (New Zealand)yesterday

Welo Global·New Zealand·USD 22.1 / hourly

audio-raterai-trainerdata-annotatorai-evaluatoraudio-annotationdata-labeling

Copy of AI Code Reviewer & Systems Evaluation Engineer 22d ago

Lifted (an Upwork Company)·India

software-engineercode-reviewerai-evaluatorsystems-engineerqa-engineerai-evaluation-engineer

Native Thai Speakers for Writing/Speaking Tasks (AI Training)2d ago

Lifted (an Upwork Company)·Thailand

ai-trainerai-raterdata-annotatorai-evaluatorfreelance-writerthai-language-services

Biomedical Evaluator - Fully Remote | Upto $120/hr2d ago

mercor·United States·USD 80 - 120 / hourly

biomedical-evaluatorclinical-evaluatorpharmaceutical-analystai-evaluatorqa-specialistmedical-evaluator

Data Analyst (AI Evaluation)2d ago

EVB·United States

data-analystai-evaluatordata-quality-analystqa-analystai-evaluation-specialistai-evaluation-analyst

Compliance AI Evaluator - Finance4d ago

mercor·United Kingdom·USD 80 - 120 / hourly

ai-evaluatorcompliance-specialistregulatory-specialistai-compliance-evaluatorai-compliance-evaluationfinancial-ai-evaluation

Financial Compliance AI Evaluator4d ago

mercor·Singapore·USD 80 - 120 / hourly

ai-evaluatorcompliance-specialistcompliance-analystai-quality-assuranceregulatory-compliance-analystai-compliance-evaluator

Financial Compliance AI Evaluator4d ago

mercor·United Kingdom·USD 80 - 120 / hourly

ai-evaluatorcompliance-evaluatorai-trainerqa-analystcompliance-specialistai-compliance-evaluator

Hazardous Device Expert - Red Team7d ago

mercor·United States·USD 65 - 75 / hourly

ai-safety-specialistred-team-specialistcontent-moderatorai-evaluatorsafety-researcherhazardous-device-specialist

SMB AI Power User — Competitive Evaluations7d ago

Invisible Technologies·United States·USD 40 - 50 / hourly

ai-evaluatorai-product-testerai-trainerprompt-engineerbusiness-operations-consultantai-evaluation

Nonprofit Program Evaluator - Expert7d ago

mercor·United Kingdom·USD 80 - 120 / hourly

program-evaluatornonprofit-evaluatorphilanthropy-specialistcommunity-program-managerai-evaluatornonprofit-program-evaluator

AI Safety Specialist - Evaluation Expert11d ago

mercor·Portugal·USD 60 - 70 / hourly

ai-safety-specialisttrust-and-safetyai-evaluatorcontent-moderationai-safety-practitionerai-safety-evaluator

AI Web Search Evaluator11d ago

Jobs for Humanity·United States·USD 14.5 / hourly

search-evaluationquality-assurancedata-annotationweb-researchai-trainingweb-search-evaluator

Analytical Evaluator - AI Feedback - AI Trainer11d ago

mercor·United States·USD 70 / hourly

ai-evaluationai-trainingcontent-evaluationquality-assuranceai-feedback-specialistai-feedback-evaluator

Evaluators for AI training (English language)11d ago

ai-trainingcontent-moderationdata-annotationquality-assuranceai-training-evaluatorai-trainer-evaluator

AI Safety Specialist - Bilingual12d ago

mercor·Australia·USD 16 - 22 / hourly

ai-safety-specialistai-safety-engineerred-team-specialistai-evaluatorai-safety-researcherai-safety-expert

Competitive Intelligence Specialist - Fully Remote | Upto $120/hr12d ago

mercor·United States·USD 80 - 120 / hourly

competitive-intelligence-specialistmarket-research-analystai-evaluatorqa-analystresearch-analystcompetitive-intelligence-analyst

Analytical Evaluator - AI Feedback13d ago

mercor·Ireland·USD 70 / hourly

ai-evaluationai-feedbackcontent-quality-assurancetechnical-writerai-research-supportai-feedback-evaluator

Management Consultants: Paid AI Output Evaluation13d ago

Terac·United States·USD 70 / hourly

ai-output-evaluationai-output-evaluatorai-evaluation-contractorai-evaluationfreelance-ai-evaluatorai-evaluator

Freelance Annotator (English) - AI Trainer15d ago

Toloka AI·India·USD 8 / hourly

annotatorai-trainerdata-annotationcontent-reviewerai-evaluatorfreelance-ai-annotator

Freelance Annotator (English) - AI Trainer15d ago

Toloka AI·Portugal·USD 13 / hourly

annotatorai-trainerdata-annotatorfreelance-ai-workai-evaluatorfreelance-ai-annotator

Freelance Annotator (English) - AI Trainer16d ago

Toloka AI·Philippines·USD 8 / hourly

ai-trainerdata-annotatorcontent-moderatorai-evaluatorannotatorfreelance-ai-annotator

Freelance Annotator (English) - AI Trainer16d ago

Toloka AI·France·USD 19 / hourly

annotatorai-trainerdata-annotatorai-evaluatorcontent-moderatorfreelance-ai-annotator

AI Trainer - Freelance Data Annotator17d ago

Toloka AI·Saudi Arabia·USD 15 / hourly

data-annotatorai-trainercontent-reviewerai-evaluatorfreelance-annotatorfreelance-ai-data-trainer

AI Trainer - Freelance Data Annotator18d ago

Toloka AI·Canada·USD 20 / hourly

annotatorai-trainerdata-annotatorai-evaluatorcontent-reviewerfreelance-ai-data-trainer

AI Trainer - Freelance Data Annotator18d ago

Toloka AI·Germany·USD 19 / hourly

ai-trainerdata-annotatorfreelance-annotatorcontent-moderatorai-evaluatorfreelance-ai-data-trainer

Analytical Evaluator - AI Feedback19d ago

mercor·United Kingdom·USD 70 / hourly

ai-evaluationtraining-data-qualitycontent-evaluationai-research-supportremote-contract-workai-feedback-evaluator

Analytical Evaluator - AI Feedback19d ago

mercor·Canada·USD 70 / hourly

ai-feedbacktraining-data-qualitycontent-evaluationai-evaluation-specialistquality-assuranceai-feedback-evaluator

Data Evaluator - Fully Remote | Upto $120/hr19d ago

mercor·India·USD 80 - 120 / hourly

ai-evaluatordata-evaluatorai-trainerqa-analystai-content-reviewerremote-ai-data-analyst

English Linguistic Expert - Evaluator19d ago

mercor·Australia·USD 50 / hourly

linguistics-expertnlp-specialistai-evaluatorlanguage-annotatorcontent-editorlinguistic-evaluator

Environmental Science Expert - Fully Remote | Upto $120/hr19d ago

mercor·Canada·USD 80 - 120 / hourly

biology-evaluatorenvironmental-science-specialistai-evaluatorscience-content-reviewertraining-data-quality-specialistenvironmental-science-expert

Privacy Compliance Expert - Evaluator19d ago

mercor·United Kingdom·USD 80 - 120 / hourly

ai-evaluatorprivacy-complianceregulatory-compliancequality-assurancecontent-evaluationprivacy-compliance-evaluator

AI Evaluation Specialist20d ago

micro1·Australia, Canada, Ireland +3 more·USD 30 - 90 / hourly

ai-evaluation-specialistai-evaluation-analystai-ml-evaluation-specialistai-model-evaluation-specialistai-evaluation-engineerai-evaluator

Clinical Reviewer - Fully Remote | Upto $120/hr22d ago

mercor·Canada·USD 80 - 120 / hourly

clinical-reviewerhealthcare-evaluatorai-evaluatorquality-assurance-healthcareclinical-assessmentremote-physician-reviewer

Compliance Specialist - Fully Remote | Upto $120/hr22d ago

mercor·Australia·USD 80 - 120 / hourly

compliance-specialistlegal-complianceai-evaluatorquality-assurancecontract-compliance-analystremote-compliance-specialist

Document Reviewer - Fully Remote | Upto $70/hr22d ago

mercor·United Kingdom·USD 50 - 70 / hourly

document-reviewerai-evaluatorcontent-quality-assuranceai-trainerai-annotatorremote-document-review-specialist

Philanthropy Evaluator - Fully Remote | Upto $120/hr22d ago

mercor·Canada·USD 80 - 120 / hourly

nonprofit-evaluatorphilanthropy-specialistcommunity-programs-evaluatorai-evaluatorcontract-evaluatorphilanthropy-evaluator

Analytical Evaluator - AI Feedback23d ago

mercor·United States·USD 70 / hourly

ai-evaluationai-training-data-qualitycontent-evaluationqa-specialistai-research-supportai-feedback-evaluator

Remote ai evaluator jobs: what to know

RemoShift tracks 117 live remote Ai Evaluator roles across 6 different employers, refreshed every 30 minutes. The roles on this page come from Himalayas and include openings at mercor, Productive Playhouse, Toloka AI — click through to the original posting to apply.

The jobs tagged ai evaluator are open to candidates in the USA, India, Canada. Each listing notes the location, salary (where disclosed) and remote setup, so you can filter by what suits you. We list only roles that link to a live original posting — no dead applications.

Live roles

117 remote ai evaluator jobs

Top employers

mercor, Productive Playhouse, Toloka AI

Common locations

the USA, India, Canada

Data sources

Himalayas

Frequently asked questions

How many remote ai evaluator jobs are there right now?

There are 117 live remote ai evaluator roles on RemoShift as of today. The count updates every 30 minutes as we re-pull company boards and partner feeds.

Can I work remotely in a ai evaluator role from anywhere?

Many ai evaluator roles are fully remote and open to candidates in the USA, India, Canada. Some are remote-within-a-region or require timezone overlap with the employer's team — each original posting states the exact arrangement. Use the Work-from-anywhere filter to narrow to truly location-independent roles.

Which companies hire remote ai evaluator staff?

Current remote ai evaluator openings include roles at mercor, Productive Playhouse, Toloka AI, Lifted (an Upwork Company), Terac and other employers. The list changes constantly as new roles are posted — browse the page above for the live set.

Explore related pages

All remote data science jobs Browse all remote jobs Remote work guides

Browse by function