Tag

73 Remote Ai Evaluation Specialist jobs

73 open remote ai evaluation specialist roles from top companies and boards — updated hourly.

Email me new ai evaluation specialist jobs
Daily email, only when there's something new. One click to stop.
Legal Expert (EU Law), AI Evaluation2d ago
Clera·Belgium, Luxembourg·USD 60 - 85 / hourly
legal-ai-evaluatorai-legal-evaluationlegal-ai-evaluationeu-law-specialistlegal-ai-specialistai-legal-specialist
Child Development - Remote10d ago
YO AI Labs·United States
developmental-psychologistchild-development-specialistresearch-analystai-evaluation-specialist
AI Data Trainer - Remote10d ago
YO AI Labs·United States·USD 30 - 60 / hourly
ai-data-trainerai-generalistai-trainerai-evaluation-specialistdata-annotator
AI Evaluation Specialist/Recent Grad - Remote10d ago
YO AI Labs·United States
ai-evaluation-specialistai-model-evaluatorai-research-specialistai-trainerqa-specialist
French Bilingual Expert - Remote10d ago
YO AI Labs·United States
ai-evaluation-specialistlinguistic-evaluation-specialistaudio-reviewai-training-specialist
Research Evaluation Specialist - Remote10d ago
YO AI Labs·United States
research-evaluation-specialistai-evaluation-specialistresearcherdata-quality-specialistai-training-data-specialist
US Tax Workflow Evaluation - Remote10d ago
YO AI Labs·United States·USD 30 - 110 / hourly
tax-evaluation-specialisttax-workflow-analystfinancial-data-annotatorai-evaluation-specialistquality-review-analyst
Japanese Bilingual AI Specialist – Remote12d ago
Productive Playhouse·Japan·USD 24 / hourly
ai-product-evaluatorai-evaluation-specialistgenerative-ai-testerai-quality-assurance-specialistai-chatbot-testing
AI Operations Analyst15d ago
FICO·United States·USD 105,000 - 165,000 / annual
ai-operations-analystai-quality-analystai-evaluation-specialistdata-quality-analystoperations-analyst
AI Safety Practitioner - Expert Evaluator18d ago
mercor·Estonia
ai-safetyai-evaluationtrust-and-safetycontent-moderationai-safety-practitionerai-safety-evaluator
AI Safety Specialist - Evaluation Expert18d ago
mercor·Ireland
ai-safety-specialisttrust-and-safety-specialistai-evaluatorai-safety-researchercontent-moderation-specialistai-safety-evaluator
AI Safety Specialist - Evaluation Expert18d ago
mercor·North Macedonia
ai-safetytrust-and-safetyai-evaluationcontent-moderationai-researchai-safety-evaluator
Brand Marketing Specialist - Fully Remote | Upto $100/hr18d ago
mercor·United States
brand-marketingbrand-strategymarketing-specialistai-evaluation-specialistbrand-positioningremote-marketing-specialist
Senior AI Product Analyst - Voice AI Agents18d ago
MEDvidi·Portugal
ai-product-analystproduct-analystdata-analystanalytics-engineerai-evaluation-specialistsenior-ai-business-analyst
AI Linguistic Quality Evaluator- Bengali (Singapore)18d ago
RWS Group·Singapore·USD 24 / hourly
ai-language-evaluatorlanguage-evaluatorlinguistai-evaluation-specialistqa-specialist
Data Science Expert - Evaluation Specialist18d ago
mercor·Germany
data-scienceai-evaluationevaluation-specialisttraining-data-specialistdata-science-expertdata-evaluation-specialist
AI Safety Specialist - Evaluation Expert19d ago
mercor·Switzerland
ai-safetytrust-and-safetyai-evaluationcontent-moderationai-researchai-safety-evaluator
Arabic Question Writer - Fully Remote | Upto $29/hr19d ago
mercor·Jordan
arabic-writercontent-creatorai-evaluation-specialisttest-writingmcq-generationfreelance-arabic-ai-content-writer
AI Safety Specialist - Evaluation Expert20d ago
mercor·Bosnia and Herzegovina
ai-safetytrust-and-safetyai-evaluationcontent-moderationai-researchai-safety-evaluator
AI Safety Specialist - Evaluation Expert20d ago
mercor·Czechia
ai-safety-specialistai-safety-practitionertrust-and-safetycontent-moderationai-evaluationai-safety-evaluator
Mathematics PhD - AI Evaluation Expert20d ago
mercor·Germany
ai-evaluatorresearch-engineeringscientific-software-developmentmathematicsai-model-testingai-ml-evaluation-specialist
AI Safety Specialist - Evaluation Expert21d ago
mercor·Albania
ai-safety-specialistai-evaluatortrust-and-safety-specialistcontent-moderation-analystai-safety-researcherai-safety-evaluator
Elite Research Scientist - Frontier AI Evaluation21d ago
Perle Systems·Argentina, Bolivia, Brazil +17 more
ai-researchscientific-researchresearch-scientistfrontier-ai-evaluationai-evaluation-specialistai-research-evaluator
Nonprofit Program Evaluator - Expert - AI Trainer21d ago
mercor·United States
nonprofit-program-evaluationai-trainingprogram-evaluatornonprofit-managementphilanthropy-programsnonprofit-program-evaluator
Generalist, Remote- Contract22d ago
Xperteez Technology·United States·USD 30 - 49 / hourly
generalistai-evaluation-specialistai-model-testerai-associateremote-contract-workremote-contract
AI Product Analyst - Automation team23d ago
MEDvidi·Spain
ai-product-analystproduct-analystdata-analystai-evaluation-specialistai-automation-product-managementai-product-business-analyst
Bilingual AI Evaluation Specialist (Japanese)23d ago
Lifted (an Upwork Company)·Peru
ai-evaluation-specialistdata-evaluation-specialistdata-annotatorlocalization-specialistjapanese-language-specialistjapanese-ai-language-specialist
Software Engineer – AI Evaluation Expert (Contractual)29d ago
Patronus AI·India·USD 30 - 100 / hourly
software-engineerai-engineermachine-learning-engineerevaluation-engineerresearch-engineerai-evaluation-engineer
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·United States·USD 30 / hourly
ai-evaluation-specialistprompt-engineerai-testerdata-science-specialistnlp-specialistai-evaluation-analyst
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·United Kingdom·USD 30 / hourly
ai-evaluation-specialistllm-evaluatordata-annotatorai-quality-assurance-specialistai-testing-specialistai-evaluation-analyst
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·Italy·USD 20 / hourly
ai-evaluation-specialistprompt-engineerdata-annotatorai-testernlp-specialistagent-evaluation-engineer
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·Canada·USD 15 - 30 / hourly
ai-evaluatordata-annotatorai-testing-specialistprompt-engineerai-quality-assurance-specialistai-evaluation-engineer
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·Greece·USD 20 / hourly
ai-evaluation-specialistai-testerai-annotatorllm-evaluatorentry-level-ai-model-evaluatorai-model-evaluation-specialist
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·Ireland·USD 15 - 30 / hourly
ai-evaluation-specialistdata-science-specialistnlp-specialistai-testing-specialistai-annotation-specialistai-evaluation-engineer
AI Voice Evaluation Specialist - 3 month contractOpen
Innodata·United States·USD 20 - 25 / hourly
ai-voice-evaluationai-evaluatorconversational-ai-testerai-quality-assurance-specialistvoice-evaluationvoice-ai-qa-specialist
AI Evaluator - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
ai-evaluatordata-annotatorai-trainercontent-reviewerllm-evaluatorpart-time-ai-evaluation
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·Singapore·USD 25 / hourly
ai-agent-evaluationai-trainerprompt-engineerdata-annotatorai-specialistagent-evaluation-engineer
Insurance Risk Subject Matter Expert | AI Evaluation Specialist (On-Call) RemoteOpen
Volga Partners·India·USD 5 - 9 / hourly
ai-evaluation-specialistinsurance-and-risk-managementclaims-auditingai-finance-specialistsubject-matter-expertinsurance-ai-specialist
Commercial Disputes Subject Matter Expert | AI Evaluation Specialist (On-Call)Open
Volga Partners·India·USD 5 - 9 / hourly
ai-evaluation-specialistclaims-auditingcommercial-disputes-smeai-finance-specialistai-training-data-analystlegal-ai-specialist
AI Safety Practitioner - Expert EvaluatorOpen
mercor·Denmark·USD 60 - 70 / hourly
ai-safety-specialistai-safety-practitionertrust-and-safety-analystai-evaluatorcontent-moderatorai-safety-evaluator
Copy of AI Code Reviewer & Systems Evaluation Engineer 2Open
Lifted (an Upwork Company)·Romania
ai-code-reviewercode-reviewersoftware-engineerai-systems-evaluatorquality-assurance-engineerai-evaluation-engineer
Copy of Senior Structural Engineer (OpenSees | AI Training & Evaluation)Open
Lifted (an Upwork Company)·United Kingdom·USD 80 - 110 / hourly
senior-structural-engineerstructural-engineerstructural-analysis-engineerai-evaluation-specialistsenior-civil-structural-engineer
Copy of AI Code Reviewer & Systems Evaluation Engineer 2Open
Lifted (an Upwork Company)·India
software-engineercode-reviewerai-evaluatorsystems-engineerqa-engineerai-evaluation-engineer
Copy of AI Code Reviewer & Systems Evaluation Engineer 2Open
Lifted (an Upwork Company)·Thailand
code-reviewersoftware-engineerai-evaluation-engineersystems-engineerai-code-reviewerai-systems-evaluator
Data Analyst (AI Evaluation)Open
EVB·United States
data-analystai-evaluatordata-quality-analystqa-analystai-evaluation-specialistai-evaluation-analyst
FP&A Specialist - Fully Remote | Upto $110/hrOpen
mercor·United Kingdom·USD 70 - 110 / hourly
fp&a-specialistfinancial-planning-and-analysisfinancial-reportingtechnical-accountingai-evaluation-specialistremote-financial-analyst
Generative Audio Evaluation - Arabic (Qatar)Open
RWS Group·Qatar·USD 10 / hourly
ai-evaluation-specialistgenerative-ai-evaluationaudio-quality-assurancearabic-language-specialistlanguage-quality-assurancearabic-language-ai-evaluation
AI Safety Specialist - Evaluation ExpertOpen
mercor·Malta·USD 60 - 70 / hourly
ai-safetyai-evaluationtrust-and-safetycontent-moderationai-safety-practitionerai-safety-evaluator
Music Producer - Korean SpecialistOpen
mercor·South Korea·USD 46 / hourly
music-productionaudio-engineeringai-evaluation-specialistmusic-quality-assurancebilingual-music-productionkorean-music-specialist
Generative Audio Evaluation - Arabic (Oman)Open
RWS Group·Oman·USD 10 / hourly
ai-evaluation-specialistgenerative-ai-evaluationaudio-quality-assurancemachine-learning-evaluationspeech-and-audio-annotationarabic-language-ai-evaluation

Remote Ai Evaluation Specialist jobs: what to know

RemoShift tracks 73 live remote ai evaluation specialist roles, refreshed every 30 minutes — every listing links straight to the original posting. Current openings come from Himalayas and include mercor, Mindrift, YO AI Labs and Lifted (an Upwork Company) plus other employers hiring this week.

Common openings right now include “AI Safety Specialist - Evaluation Expert”, “AI Agent Evaluation Specialist” and “Copy of AI Code Reviewer & Systems Evaluation Engineer 2”. By current openings, these roles hire mostly in the USA (19), the UK (8) and India (5). None of the current listings are flagged work-from-anywhere, so every role here is tied to a stated region or timezone — each posting spells out the arrangement.

The seniority mix runs mid (71) and senior (2), so the market skews toward mid roles — 97% of the current set. Pay is disclosed on only a minority of listings — use the has-salary filter to see the ones that publish a range.

Live roles
73 live remote ai evaluation specialist jobs
Top employers
mercor, Mindrift, YO AI Labs, Lifted (an Upwork Company), RWS Group and MEDvidi
Common locations
the USA, the UK and India
Remote policy
Region/timezone-bound
Seniority mix
mid (71) and senior (2)
Data sources
Himalayas

Frequently asked questions

How much do remote ai evaluation specialist jobs pay?
Pay varies by employer, region and seniority, and only a minority of remote ai evaluation specialist listings publish a range — use the has-salary filter to see those first. Where no range is listed, the original posting states the comp structure; expect the band typical for the role and region.
Are remote ai evaluation specialist jobs open to candidates anywhere?
None of the current remote ai evaluation specialist listings are work-from-anywhere: these roles are remote within a region or timezone. Openings concentrate in the USA, the UK and India, and each posting states the exact rule.
What seniority levels hire for remote ai evaluation specialist roles?
Current listings skew mid (71) and senior (2) — mid roles alone are 97% of the set. Use the seniority filter to narrow the live list, and check each posting for the exact band and any experience floor.

Explore related pages

All remote data science jobsBrowse all remote jobsRemote work guides

Browse by function