Tag

212 remote Ai Evaluation Specialist jobs

212 open remote Ai Evaluation Specialist roles from top companies and boards — updated hourly.

Copy of Senior Structural Engineer (OpenSees | AI Training & Evaluation)yesterday

Lifted (an Upwork Company)·United Kingdom·USD 80 - 110 / hourly

senior-structural-engineerstructural-engineerstructural-analysis-engineerai-evaluation-specialistsenior-civil-structural-engineer

AI Safety Practitioner - Expert Evaluatoryesterday

mercor·Denmark·USD 60 - 70 / hourly

ai-safety-specialistai-safety-practitionertrust-and-safety-analystai-evaluatorcontent-moderatorai-safety-evaluator

Copy of AI Code Reviewer & Systems Evaluation Engineer 2yesterday

Lifted (an Upwork Company)·Romania

ai-code-reviewercode-reviewersoftware-engineerai-systems-evaluatorquality-assurance-engineerai-evaluation-engineer

Copy of AI Code Reviewer & Systems Evaluation Engineer 22d ago

Lifted (an Upwork Company)·India

software-engineercode-reviewerai-evaluatorsystems-engineerqa-engineerai-evaluation-engineer

Copy of AI Code Reviewer & Systems Evaluation Engineer 22d ago

Lifted (an Upwork Company)·Thailand

code-reviewersoftware-engineerai-evaluation-engineersystems-engineerai-code-reviewerai-systems-evaluator

Data Analyst (AI Evaluation)2d ago

EVB·United States

data-analystai-evaluatordata-quality-analystqa-analystai-evaluation-specialistai-evaluation-analyst

FP&A Specialist - Fully Remote | Upto $110/hr9d ago

mercor·United Kingdom·USD 70 - 110 / hourly

fp&a-specialistfinancial-planning-and-analysisfinancial-reportingtechnical-accountingai-evaluation-specialistremote-financial-analyst

Generative Audio Evaluation - Arabic (Qatar)9d ago

RWS Group·Qatar·USD 10 / hourly

ai-evaluation-specialistgenerative-ai-evaluationaudio-quality-assurancearabic-language-specialistlanguage-quality-assurancearabic-language-ai-evaluation

AI Safety Specialist - Evaluation Expert10d ago

mercor·Malta·USD 60 - 70 / hourly

ai-safetyai-evaluationtrust-and-safetycontent-moderationai-safety-practitionerai-safety-evaluator

Generative Audio Evaluation - Arabic (Oman)10d ago

RWS Group·Oman·USD 10 / hourly

ai-evaluation-specialistgenerative-ai-evaluationaudio-quality-assurancemachine-learning-evaluationspeech-and-audio-annotationarabic-language-ai-evaluation

Music Producer - Korean Specialist10d ago

mercor·South Korea·USD 46 / hourly

music-productionaudio-engineeringai-evaluation-specialistmusic-quality-assurancebilingual-music-productionkorean-music-specialist

FP&A Specialist - Fully Remote | Upto $110/hr11d ago

mercor·United States·USD 70 - 110 / hourly

fp&a-specialistfinancial-planning-and-analysisfinancial-reportingai-evaluation-specialistcontract-finance-analystremote-financial-analyst

AI Safety Specialist - Evaluation Expert11d ago

mercor·San Marino·USD 60 - 70 / hourly

ai-safetytrust-and-safetyai-evaluationcontent-moderationai-safety-practitionerai-safety-evaluator

AI Safety Specialist - Evaluation Expert11d ago

mercor·Belgium·USD 60 - 70 / hourly

ai-safetyai-safety-evaluationtrust-and-safetycontent-moderationai-researchai-safety-evaluator

AI Safety Specialist - Evaluation Expert11d ago

mercor·Portugal·USD 60 - 70 / hourly

ai-safety-specialisttrust-and-safetyai-evaluatorcontent-moderationai-safety-practitionerai-safety-evaluator

AI Safety Specialist - Evaluation Expert11d ago

mercor·Greece·USD 60 - 70 / hourly

ai-safety-specialistai-safety-practitionertrust-and-safetycontent-moderationai-evaluationai-safety-evaluator

AI Safety Specialist - Evaluation Expert11d ago

mercor·Lithuania·USD 60 - 70 / hourly

ai-safety-evaluationtrust-and-safetycontent-moderationai-safetyai-researchai-safety-evaluator

AI Safety Specialist - Evaluation Expert11d ago

mercor·Liechtenstein·USD 60 - 70 / hourly

ai-safetytrust-and-safetyai-evaluationcontent-moderationai-researchai-safety-evaluator

Evaluators for AI training (English language)11d ago

ai-trainingcontent-moderationdata-annotationquality-assuranceai-training-evaluatorai-trainer-evaluator

Turkish Music Producer - Evaluator11d ago

mercor·France·USD 16 / hourly

music-productionaudio-engineeringai-evaluation-specialistsound-mixingturkish-music-specialistmusic-evaluator

Healthcare Operations Specialist - Fully Remote | Upto $120/hr12d ago

mercor·United Kingdom·USD 80 - 120 / hourly

healthcare-operationsai-evaluation-specialistquality-assuranceoperations-evaluatorremote-healthcare-jobshealthcare-operations-specialist

AI Research Peer Review Evaluator (ML/AI)12d ago

Lightly AG·Switzerland

ai-researchml-ai-researchscientific-peer-reviewresearch-and-evaluationacademic-researchai-research-reviewer

AI Safety Specialist - Evaluation Expert12d ago

mercor·Norway·USD 60 - 70 / hourly

ai-safetytrust-and-safetyai-evaluationcontent-moderationai-researchai-safety-evaluator

AI Safety Specialist - Evaluation Expert12d ago

mercor·Slovenia·USD 60 - 70 / hourly

ai-safetytrust-and-safetycontent-evaluationai-safety-researchevaluation-specialistai-safety-evaluator

AI Safety Specialist - Evaluation Expert12d ago

mercor·France·USD 60 - 70 / hourly

ai-safetytrust-and-safetycontent-moderationai-evaluationai-safety-practitionerai-safety-evaluator

AI Safety Specialist - Evaluation Expert12d ago

mercor·Finland·USD 60 - 70 / hourly

ai-safetytrust-and-safetyai-evaluationcontent-moderationai-safety-practitionerai-safety-evaluator

AI Safety Specialist - Evaluation Expert12d ago

mercor·Iceland·USD 60 - 70 / hourly

ai-safetytrust-and-safetycontent-moderationai-evaluationai-safety-specialistai-safety-evaluator

Music Producer - Hebrew Specialist12d ago

mercor·United Kingdom·USD 17 - 42 / hourly

music-productionaudio-engineeringai-evaluation-specialistmusic-quality-assurancehebrew-language-specialistmusic-production-specialist

AI Personalization Evaluation – English (United States); Project Athabasca13d ago

CrowdGen by Appen·United States·USD 18 / hourly

ai-trainers-domain-expertsai-evaluationpersonalizationuser-researchdata-annotationai-evaluation-specialist

Freelance Agent Evaluation Engineer13d ago

Mindrift·South Africa·USD 40 / hourly

ai-testing-engineersoftware-quality-assuranceai-evaluation-specialistqa-automation-engineeragent-evaluation-engineerfreelance-ai-evaluator

Music Producer - Evaluation Specialist13d ago

mercor·Slovakia·USD 20 - 36 / hourly

music-productionaudio-engineeringmusic-quality-assuranceai-evaluation-specialistmusic-labelingmusic-evaluation-specialist

Music Producer - Korean Specialist13d ago

mercor·United States·USD 35 - 62 / hourly

music-productionaudio-engineeringai-evaluation-specialistkorean-language-specialistmusic-quality-assurancekorean-music-specialist

Telugu Music Producer - Expert13d ago

mercor·Singapore·USD 11 - 19 / hourly

music-productionaudio-engineeringai-evaluation-specialisttelugu-musicmusic-quality-assurancetelugu-music-expert

Finance Evaluator - Fully Remote | Upto $120/hr14d ago

mercor·United Kingdom·USD 80 - 120 / hourly

fp&a-evaluatorcorporate-finance-evaluatorfinancial-evaluatorai-evaluation-specialistfinance-contractorremote-finance-evaluator

AI Safety Specialist - Evaluation Expert15d ago

mercor·Italy·USD 60 - 70 / hourly

ai-safetyai-evaluationtrust-and-safetycontent-moderationai-researchai-safety-evaluator

AI Safety Specialist - Evaluation Expert15d ago

mercor·Monaco·USD 60 - 70 / hourly

ai-safetyai-evaluationtrust-and-safetycontent-moderationai-safety-practitionerai-safety-evaluator

AI Safety Specialist - Evaluation Expert15d ago

mercor·Romania·USD 60 - 70 / hourly

ai-safetytrust-and-safetyai-evaluationcontent-moderationai-safety-practitionerai-safety-evaluator

AI Trainer - Freelance Data Annotator15d ago

Toloka AI·Ireland·USD 19 / hourly

data-annotationai-trainerfreelance-data-annotatorcontent-moderationai-evaluation-specialistfreelance-ai-data-trainer

Freelance Annotator (English) - AI Trainer16d ago

Toloka AI·Mexico·USD 9 / hourly

annotatorai-trainerdata-annotationcontent-moderationai-evaluation-specialistfreelance-ai-annotator

French Audio Evaluations Specialist - Freelance AI Trainer Project16d ago

Invisible Technologies·France·USD 6 - 65 / hourly

language-and-linguisticsai-trainingaudio-evaluationdata-annotationquality-assuranceai-evaluation-specialist

Speech AI Evaluation Specialist - Bengali (India)16d ago

RWS Group·Bangladesh·USD 4 / hourly

speech-ai-evaluationai-content-evaluationdata-annotatorlanguage-specialistfreelance-ai-workai-evaluation

Speech AI Evaluation Specialist - French (France)16d ago

RWS Group·France·USD 16.5 / hourly

speech-ai-evaluationfrench-language-ai-specialistai-data-annotationconversational-ai-testingai-model-evaluationlanguage-quality-assurance

Speech AI Evaluation Specialist - Italian (Italy)16d ago

RWS Group·Italy·USD 11 / hourly

ai-evaluationdata-annotationspeech-aiquality-assurancecontent-evaluationspeech-ai-evaluator

Speech AI Evaluation Specialist - Chinese Simplified (USA)17d ago

RWS Group·United States·USD 18 / hourly

ai-evaluationspeech-aidata-annotationai-trainingquality-assurancespeech-ai-evaluator

Speech AI Evaluation Specialist - German (Germany)17d ago

RWS Group·Germany·USD 18 / hourly

ai-evaluation-specialistspeech-ai-testingdata-quality-assuranceai-training-specialistlanguage-technology-testingcontent-evaluation

Speech AI Evaluation Specialist - Spanish (Mexico)17d ago

RWS Group·Mexico·USD 7 / hourly

ai-evaluationlanguage-testingspeech-aiai-trainingdata-annotationspeech-ai-evaluator

Speech AI Evaluation Specialist - Vietnamese (USA)17d ago

RWS Group·United States·USD 18 / hourly

ai-evaluation-specialistdata-annotationspeech-ai-evaluationai-training-data-specialistlanguage-quality-assurancespeech-ai-evaluator

AI Safety Specialist - Evaluation Expert18d ago

mercor·Latvia·USD 60 - 70 / hourly

ai-safetytrust-and-safetyai-evaluationcontent-moderationai-safety-researchai-safety-evaluator

AI Safety Specialist - Evaluation Expert18d ago

mercor·Kosovo·USD 60 - 70 / hourly

ai-safetyai-evaluationtrust-and-safetycontent-moderationai-safety-practitionerai-safety-evaluator

AI Trainer - Freelance Data Annotator18d ago

Toloka AI·United States·USD 20 / hourly

data-annotatorai-trainercontent-moderatorfreelance-data-annotationai-evaluation-specialistfreelance-ai-data-trainer

Remote ai evaluation specialist jobs: what to know

RemoShift tracks 212 live remote Ai Evaluation Specialist roles across 6 different employers, refreshed every 30 minutes. The roles on this page come from Himalayas and include openings at mercor, Mindrift, Productive Playhouse — click through to the original posting to apply.

The jobs tagged ai evaluation specialist are open to candidates in the USA, Germany, the UK. Each listing notes the location, salary (where disclosed) and remote setup, so you can filter by what suits you. We list only roles that link to a live original posting — no dead applications.

Live roles

212 remote ai evaluation specialist jobs

Top employers

mercor, Mindrift, Productive Playhouse

Common locations

the USA, Germany, the UK

Data sources

Himalayas

Frequently asked questions

How many remote ai evaluation specialist jobs are there right now?

There are 212 live remote ai evaluation specialist roles on RemoShift as of today. The count updates every 30 minutes as we re-pull company boards and partner feeds.

Can I work remotely in a ai evaluation specialist role from anywhere?

Many ai evaluation specialist roles are fully remote and open to candidates in the USA, Germany, the UK. Some are remote-within-a-region or require timezone overlap with the employer's team — each original posting states the exact arrangement. Use the Work-from-anywhere filter to narrow to truly location-independent roles.

Which companies hire remote ai evaluation specialist staff?

Current remote ai evaluation specialist openings include roles at mercor, Mindrift, Productive Playhouse, RWS Group, Lifted (an Upwork Company) and other employers. The list changes constantly as new roles are posted — browse the page above for the live set.

Explore related pages

All remote data science jobs Browse all remote jobs Remote work guides

Browse by function