✈︎ Flight+ HotelPost Job
Tag

212 remote Ai Evaluation Specialist jobs

212 open remote Ai Evaluation Specialist roles from top companies and boards — updated hourly.

remote (16803)sales (5411)software-engineer (5347)business-development (4658)account-management (3724)b2b-sales (3641)customer-service (2996)digital-marketing (2609)enterprise-sales (2546)project-management (2286)fulltime (2203)operations (2180)product-management (2125)account-executive (2089)backend-development (2050)data-engineering (1781)backend-engineering (1756)customer-success (1743)saas-sales (1710)marketing (1701)fullstack-development (1649)healthcare-administration (1610)cloud-engineer (1595)devops-engineer (1573)platform-engineering (1570)
Management Evaluator - Fully Remote | Upto $120/hrAug 20, 2026
mercor·Canada·USD 80 - 120 / hour
management-evaluatorbusiness-strategy-analystai-evaluation-specialistcontract-evaluatorfreelance-consultantperformance-evaluation-manager
Psychiatry Expert - Fully Remote | Upto $150/hrAug 20, 2026
mercor·Germany
psychiatry-consultingai-evaluation-specialistmedical-ai-specialistclinical-ai-researcherpsychiatric-assessment-expertremote-psychiatrist
Psychiatry Expert - Fully Remote | Upto $150/hrAug 20, 2026
mercor·Sweden
psychiatrymedical-consultinghealthcare-aiclinical-researchai-evaluation-specialistremote-psychiatrist
AI Safety Practitioner - Expert EvaluatorAug 18, 2026
mercor·Ireland·USD 60 - 70 / hour
ai-safetytrust-and-safetycontent-evaluationai-researchquality-assuranceai-safety-evaluator
Senior Affiliate Media Buyer (Meta & TikTok) for KerdixoAug 18, 2026
TalentIn·Bulgaria, Georgia, Germany +9 more
media-buy-uamedia-buyersenior-affiliate-media-buyerperformance-marketinguser-acquisitionpaid-social
AI Evaluator - Software Expert - AI TrainerAug 17, 2026
mercor·United States·USD 80 - 120 / hour
ai-evaluatorai-trainersoftware-quality-assurancetechnical-content-evaluatorai-model-graderai-training-evaluator
Board-Certified Psychiatrist - SubspecialistAug 17, 2026
mercor·Germany·USD 150 / hourly
psychiatrymedical-consultingai-evaluation-specialistclinical-consultingmental-healthboard-certified-psychiatrist
CS Benchmark Expert - Fully Remote | Upto $84/hrAug 17, 2026
mercor·United Kingdom·USD 66 - 84 / hourly
technical-assessment-designai-evaluation-specialistbenchmark-developmentcomputer-science-educationtechnical-content-creationremote-ai-benchmark-analyst
Generative AI Analyst | Spanish (Mexico)Aug 17, 2026
Welo Global·Mexico·USD 4.8 / hourly
generative-ai-analystai-data-annotationai-evaluation-specialistdata-quality-reviewercontent-moderationremote-spanish-ai-data-annotation-specialist
AI Safety Practitioner - Expert EvaluatorAug 16, 2026
mercor·Switzerland·USD 60 - 70 / hour
ai-safetytrust-and-safetyai-evaluationcontent-moderationai-safety-practitionerai-safety-evaluator
AI Safety Practitioner - Expert EvaluatorAug 16, 2026
mercor·Germany·USD 60 - 70 / hour
ai-safetytrust-and-safetyai-evaluationcontent-moderationai-research-supportai-safety-evaluator
AI Assessment Specialist - PhDAug 15, 2026
mercor·Germany·USD 66 - 84 / hour
technical-assessment-specialistai-assessment-specialistcomputer-science-specialistbenchmark-content-developerassessment-question-writerai-evaluation-specialist
Computational Seismology Expert - PhDAug 15, 2026
mercor·Germany·USD 70 - 85 / hour
computational-seismologygeophysics-expertai-evaluation-specialistscientific-computingproblem-designgeophysical-data-scientist
Consulting Specialist - Fully Remote | Upto $150/hrAug 15, 2026
mercor·United Kingdom·USD 100 - 150 / hourly
remote-consultantremote-consultingremote-specialistmanagement-consultingstrategy-consultingbusiness-analysis
Data Scientist - AI EvaluationAug 15, 2026
mercor·Germany·USD 100 - 150 / hour
data-scienceai-evaluationmachine-learningquantitative-analysisdata-scientistai-data-evaluation
Music Audio Specialist - Fully Remote | Upto $14/hrAug 15, 2026
mercor·Singapore
music-productionaudio-engineeringai-evaluation-specialistmusic-quality-assuranceaudio-quality-assuranceaudio-quality-assurance-specialist
Audio Engineer - Fully Remote | Upto $43/hrAug 14, 2026
mercor·United States
music-and-audio-expertaudio-engineeringmusic-productionsound-mixingai-evaluation-specialistaudio-engineer
AI Safety Specialist - Fully Remote | Upto $70/hrAug 13, 2026
mercor·Iceland·USD 60 - 70 / hour
ai-safetytrust-and-safetyai-safety-practitionercontent-moderationai-evaluation-specialistai-safety-specialist
Audio Engineer - Fully Remote | Upto $17/hrAug 13, 2026
mercor·Mexico
audio-engineeringmusic-productionsound-mixingmusic-and-audio-expertai-evaluation-specialistaudio-engineer
Audio Engineer - Fully Remote | Upto $46/hrAug 13, 2026
mercor·Singapore
audio-engineeringmusic-productionsound-engineeringai-evaluation-specialistmusic-and-audio-expertaudio-engineer
Igbo - AI Product EvaluatorAug 13, 2026
Productive Playhouse·Nigeria·USD 800/hour
ai-evaluatorai-evaluation-specialistai-product-testerai-evaluationlanguage-servicesgenerative-ai-testing
Italian - AI Product EvaluatorAug 13, 2026
Productive Playhouse·Italy·USD 1,800/hour
ai-product-evaluationlinguistic-testingai-quality-assurancelanguage-servicesgenerative-ai-evaluationai-product-evaluator
Language Model Analyst - Fully Remote | Upto $20/hr Part-timeAug 13, 2026
mercor·Singapore·USD 15 - 20 / hour
language-model-analystai-evaluation-specialistdata-annotatormodel-evaluation-analystai-content-reviewerremote-ai-data-analyst
Music Audio Specialist - Fully Remote | Upto $14/hrAug 13, 2026
mercor·United States
music-productionaudio-engineeringai-evaluation-specialistmusic-quality-assuranceaudio-expertremote-multimedia-specialist
Research Specialist - Fully Remote | Upto $60/hrAug 13, 2026
mercor·Australia·USD 50 - 60 / hour
research-specialistai-research-associatelanguage-model-trainingresearch-analystai-evaluation-specialistremote-part-time-research-specialist
Swedish - AI Product EvaluatorAug 13, 2026
Productive Playhouse·Sweden·USD 2,000/hour
ai-evaluationlinguistic-testinglanguage-servicesqa-testingai-chatbot-testingai-product-evaluator
Gujarati - AI Product EvaluatorAug 12, 2026
Productive Playhouse·India·USD 800/hour
ai-product-evaluationlinguistic-quality-assurancelanguage-servicesai-testinggenerative-ai-evaluationai-product-evaluator
Albanian - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Albania
ai-evaluationlinguistic-testinglanguage-servicesai-product-testinggenerative-ai-evaluationai-product-evaluator
Armenian - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Armenia
ai-evaluationai-product-testinglanguage-model-evaluationgenerative-ailinguistic-testingai-annotator
British English - AI Product EvaluatorAug 12, 2026
Productive Playhouse·United Kingdom·USD 1,800/hour
ai-evaluationai-product-testinglanguage-model-testinggenerative-ailinguistic-evaluationai-product-evaluator
Claims Auditing Subject Matter Expert | AI Evaluation Specialist (On-Call)Aug 12, 2026
Volga Partners·United States·USD 35 - 42 / hour
claims-auditingai-evaluation-specialistinsurance-claims-auditingfinancial-auditingrisk-managementclaims-audit-specialist
Dutch - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Netherlands·USD 2,000/hour
ai-evaluatorgenerative-ai-evaluationlanguage-quality-assurancelinguistic-ai-testingai-chatbot-testingai-product-evaluator
Filipino - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Philippines·USD 800/hour
ai-evaluationgenerative-ailanguage-testingai-product-testinglinguistic-evaluationai-product-evaluator
Freelance Agent Evaluation EngineerAug 12, 2026
Mindrift·France·USD 50 / hourly
agent-evaluation-engineerai-evaluation-specialistsoftware-engineertechnical-evaluatorai-testing-engineerfreelance-ai-evaluator
Hausa - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Niger, Nigeria·USD 800/hour
ai-product-evaluatorlanguage-testingai-evaluation-specialistlinguistic-quality-assurancegenerative-ai-testerai-product-evaluation
Polish - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Poland·USD 1,400/hour
ai-evaluationllm-evaluationgenerative-ailanguage-testingai-safety-assessmentchatbot-evaluation
Senior Python Engineer - AI Coding Agent Evaluation (Freelance)Aug 12, 2026
mindrift·Portugal·USD 150 / hourly
senior-python-engineerai-evaluation-specialistfreelance-software-developersoftware-testing-engineerai-quality-assurancesenior-python-developer---ai-ml
Somali - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Somalia·USD 800/hour
ai-evaluationlinguistic-testinglanguage-servicesproduct-testingai-chatbot-evaluatorai-product-evaluator
Tamil - AI Product EvaluatorAug 12, 2026
Productive Playhouse·India·USD 800/hour
ai-evaluationlanguage-testingtamil-language-specialistai-product-testinggenerative-ai-evaluatorai-product-evaluation
Telugu - AI Product EvaluatorAug 12, 2026
Productive Playhouse·India·USD 800/hour
ai-product-evaluatorlinguistic-evaluationai-testinglanguage-servicesgenerative-ai-evaluationdevelopmental-projects
Turkish - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Turkey·USD 1,200/hour
ai-evaluationai-testinglanguage-model-evaluationai-annotatorlinguistic-qaai-product-evaluator
Vietnamese - AI Product EvaluatorAug 12, 2026
Productive Playhouse·Vietnam·USD 900/hour
ai-evaluationlanguage-servicesai-testinglinguistic-qagenerative-ai-testingai-product-evaluator
Audio Engineer - Fully Remote | Upto $26/hrAug 11, 2026
mercor·Brazil
audio-engineeringmusic-productionsound-engineeringmusic-and-audio-expertai-evaluation-specialistaudio-engineer
Audio Engineer - Fully Remote | Upto $32/hrAug 11, 2026
mercor·Egypt
audio-engineeringmusic-productionsound-engineeringaudio-quality-assuranceai-evaluation-specialistaudio-engineer
Audio Engineer - Fully Remote | Upto $43/hrAug 11, 2026
mercor·Austria
audio-engineeringmusic-productionsound-engineeringai-evaluation-specialistmusic-compositionaudio-engineer
Audit Support Specialist - Fully Remote | Upto $120/hrAug 11, 2026
mercor·Canada·USD 80 - 120 / hour
ai-quality-assurancefinance-operationsaudit-supportdocument-reviewai-evaluation-specialistaudit-support-specialist
Consulting Specialist - Fully Remote | Upto $150/hrAug 11, 2026
mercor·Germany·USD 100 - 150 / hour
management-consultingbusiness-consultingai-evaluation-specialistconsulting-analystremote-consultantremote-consulting
Consulting Specialist - Fully Remote | Upto $150/hrAug 11, 2026
mercor·India·USD 100 - 150 / hour
management-consultingai-evaluation-specialisttalent-network-consultantquality-assurance-consultantremote-consultantremote-consulting
Data Science Expert - AI EvaluationAug 11, 2026
mercor·Germany·USD 120 - 170 / hourly
data-scienceai-evaluationai-trainingbusiness-intelligence-and-analyticsai-evaluation-specialistai-ml-evaluation-specialist
Finance Specialist - Fully Remote | Upto $90/hr Part-timeAug 11, 2026
mercor·United States·USD 65 - 90 / hour
finance-specialistfinancial-analysisai-evaluation-specialistcontract-financeremote-finance-specialistremote-financial-operations-specialist
12345

Remote ai evaluation specialist jobs: what to know

RemoShift tracks 212 live remote Ai Evaluation Specialist roles across 6 different employers, refreshed every 30 minutes. The roles on this page come from Himalayas and include openings at mercor, Mindrift, Productive Playhouse — click through to the original posting to apply.

The jobs tagged ai evaluation specialist are open to candidates in the USA, Germany, the UK. Each listing notes the location, salary (where disclosed) and remote setup, so you can filter by what suits you. We list only roles that link to a live original posting — no dead applications.

Live roles
212 remote ai evaluation specialist jobs
Top employers
mercor, Mindrift, Productive Playhouse
Common locations
the USA, Germany, the UK
Data sources
Himalayas

Frequently asked questions

How many remote ai evaluation specialist jobs are there right now?
There are 212 live remote ai evaluation specialist roles on RemoShift as of today. The count updates every 30 minutes as we re-pull company boards and partner feeds.
Can I work remotely in a ai evaluation specialist role from anywhere?
Many ai evaluation specialist roles are fully remote and open to candidates in the USA, Germany, the UK. Some are remote-within-a-region or require timezone overlap with the employer's team — each original posting states the exact arrangement. Use the Work-from-anywhere filter to narrow to truly location-independent roles.
Which companies hire remote ai evaluation specialist staff?
Current remote ai evaluation specialist openings include roles at mercor, Mindrift, Productive Playhouse, RWS Group, Lifted (an Upwork Company) and other employers. The list changes constantly as new roles are posted — browse the page above for the live set.

Explore related pages

All remote data science jobsBrowse all remote jobsRemote work guides

Browse by function