Tag

76 Remote Ai Evaluator jobs

76 open remote ai evaluator roles from top companies and boards — updated hourly.

Email me new ai evaluator jobs
Daily email, only when there's something new. One click to stop.
Junior Data Scientist - Remote10d ago
YO AI Labs·United States
junior-data-scientistdata-scientistquantitative-analystmachine-learning-scientistai-evaluator
AI Safety Specialist - Evaluation Expert18d ago
mercor·Ireland
ai-safety-specialisttrust-and-safety-specialistai-evaluatorai-safety-researchercontent-moderation-specialistai-safety-evaluator
Competitive Intelligence Analyst - Fully Remote | Upto $120/hr19d ago
mercor·Canada
competitive-intelligence-analystmarket-research-analystai-evaluatorqa-specialistresearch-analystcompetitive-intelligence-specialist
Inventory Specialist - Fully Remote | Upto $120/hr19d ago
mercor·United States
operations-specialistinventory-specialistcapacity-planningai-evaluatorqa-specialistinventory-and-logistics-specialist
AI Photo Rater19d ago
micro1·United States
ai-raterai-model-raterai-data-raterai-content-raterai-training-data-raterai-photo-contributor
AI Software Engineering Domain Expert | Remote - Contract19d ago
Xperteez Technology·Worldwide
ai-trainerai-evaluatordata-annotatorai-content-specialisttechnical-writerremote-senior-ai-engineer
Competitive Intelligence Analyst - Fully Remote | Upto $120/hr19d ago
mercor·India
competitive-intelligencemarket-research-analystai-evaluatorqa-analystresearch-analystcompetitive-intelligence-analyst
Nonprofit Program Evaluator - Expert20d ago
mercor·United States
program-evaluatornonprofit-program-evaluationai-evaluatorcommunity-program-managerphilanthropy-specialistnonprofit-program-evaluator
Mathematics PhD - AI Evaluation Expert20d ago
mercor·Germany
ai-evaluatorresearch-engineeringscientific-software-developmentmathematicsai-model-testingai-ml-evaluation-specialist
AI Safety Specialist - Evaluation Expert21d ago
mercor·Albania
ai-safety-specialistai-evaluatortrust-and-safety-specialistcontent-moderation-analystai-safety-researcherai-safety-evaluator
Food Delivery AI Response Evaluator21d ago
micro1·Worldwide·USD 10 - 30 / hourly
ai-response-evaluatorai-response-evaluationai-response-evaluation-specialistai-feedback-evaluatorai-response-graderai-evaluator
General AI Data Annotator - Spanish (United States)22d ago
RWS Group·United States·USD 21.5 / hourly
ai-data-annotatordata-annotatorai-evaluatorremote-spanish-ai-data-annotation-specialistai-language-data-annotation-specialistai-data-annotation-analyst
QA - Mandarin (Singapore)22d ago
TransPerfect·Singapore
qa-specialistai-evaluatordata-annotatorlanguage-quality-specialistlanguage-qalinguistic-qa
AI Agent Evaluation Specialist (CS / Data Science Students Welcome)Open
Mindrift·Canada·USD 15 - 30 / hourly
ai-evaluatordata-annotatorai-testing-specialistprompt-engineerai-quality-assurance-specialistai-evaluation-engineer
AI Safety Specialist - Fully Remote | Up to $22/hrOpen
mercor·United States·USD 16 - 22 / hourly
ai-safety-specialistai-trainerai-evaluatorcontent-moderatormachine-learning-engineerai-safety-analyst
Shape the Future of AI — Thai Talent HubOpen
Welocalize·Thailand
ai-trainerdata-annotatorlinguistai-evaluatorlanguage-specialistthai-ai-data-trainer
British English Gen AI TrainerOpen
Welocalize·United Kingdom·USD 19.5 / hourly
generative-ai-analystai-trainerdata-annotatorcontent-reviewerai-evaluatorgenerative-ai-trainer
Government Subject Matter Expert (SME) - AI Model EvaluationOpen
Volga Partners·United States·USD 35 - 40 / hourly
subject-matter-expertgovernment-analystcompliance-analystregulatory-analystai-evaluatorai-model-evaluation
Healthcare Subject Matter Expert (SME) - AI Model Evaluation (US)Open
Volga Partners·United States·USD 45 - 160 / hourly
healthcare-ai-specialistai-evaluatormedical-review-specialistclinical-quality-analysthealthcare-technology-specialisthealthcare-ai-evaluator
AI Product EvaluatorOpen
micro1·Japan·USD 14 - 36 / hourly
ai-product-evaluatorai-product-evaluationai-evaluatorai-product-reviewerai-evaluation-analystai-product-tester
AI Workflow Associate - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
ai-trainerdata-annotatorcontent-reviewerai-evaluatornlp-specialistai-workflow-specialist
Generative AI Associate - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
ai-trainerai-evaluatordata-annotatorprompt-engineernlp-specialistgenerative-ai-associate
Generative AI Associate(PHD) - Flexible HoursOpen
Innodata·United States·USD 25 - 30 / hourly
ai-evaluatorgenerative-ai-specialistai-trainerdata-annotatormachine-learning-data-annotatorgenerative-ai-associate
AI Voice Evaluation Specialist - 3 month contractOpen
Innodata·United States·USD 20 - 25 / hourly
ai-voice-evaluationai-evaluatorconversational-ai-testerai-quality-assurance-specialistvoice-evaluationvoice-ai-qa-specialist
AI Quality Analyst - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
ai-quality-analystai-trainerai-annotatordata-annotatorai-evaluatorai-quality-assurance-analyst
AI Systems User - Fully Remote | Upto $30/hrOpen
mercor·Japan·USD 30 / hourly
ai-testerai-evaluatorai-interface-testingproduct-testerux-researcherremote-ai-work
AI Safety Specialist - Fully Remote | Up to $45/hrOpen
mercor·United Kingdom·USD 40 - 45 / hourly
ai-safety-specialistcontent-reviewerai-annotatordata-annotatorai-evaluatorai-safety-analyst
AI Workflow Specialist - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
generative-ai-specialistai-trainerai-evaluatorprompt-engineerdata-annotatorai-workflow-specialist
Generative AI Specialist - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
ai-evaluatorgenerative-ai-specialistai-trainerdata-annotatorcontent-reviewergenerative-ai-engineer
Latvian Gen AI TrainerOpen
Welocalize·Latvia·USD 8.5 / hourly
generative-ai-analystai-trainerdata-annotatorlanguage-specialistai-evaluatorgenerative-ai-trainer
AI Evaluator - Flexible HoursOpen
Innodata·United States·USD 15 / hourly
ai-evaluatordata-annotatorai-trainercontent-reviewerllm-evaluatorpart-time-ai-evaluation
Arabic (Morocco) Gen AI TrainerOpen
Welocalize·Morocco·USD 4.5 / hourly
ai-trainerdata-annotatorai-evaluatorcontent-reviewerai-data-analystfreelance-arabic-dialect-ai-trainer
Japanese Culture ExpertOpen
Welocalize·Japan·USD 50.75 - 57.75 / hourly
japanese-language-expertcultural-consultantai-evaluatorqa-specialistlocalization-specialistjapanese-cultural-content-specialist
Slovak Gen AI TrainerOpen
Welocalize·Slovakia·USD 12.1 / hourly
ai-trainerdata-annotatorlanguage-specialistai-evaluatorcontent-reviewerslovak-trainer
Korean PhD Subject Matter ExpertsOpen
Welocalize·South Korea·USD 60 / hourly
subject-matter-expertai-trainerai-evaluatorlanguage-specialistresearch-consultantkorean-specialist
Japanese Gen AI TrainerOpen
Welocalize·Japan
ai-trainerdata-annotatorai-evaluatorlanguage-specialistcontent-reviewergenerative-ai-trainer
Spanish (Mexico) Gen AI TrainerOpen
Welocalize·Mexico
ai-trainerai-evaluatordata-annotatorlanguage-specialistcontent-reviewerentry-level-spanish-ai-data-trainer
Spanish (US) Gen AI TrainerOpen
Welocalize·United States
generative-ai-analystai-trainerdata-annotatorai-evaluatorcontent-reviewergenerative-ai-trainer
Maltese Gen AI TrainerOpen
Welocalize·Malta·USD 12 / hourly
ai-trainerdata-annotatorcontent-reviewerai-evaluatorqa-specialistgenerative-ai-trainer
Search Engine Evaluator - Dutch (Netherlands)Open
RWS Group·Netherlands·USD 19 / hourly
search-engine-evaluatorsearch-quality-raterai-evaluatorinternet-evaluatorsearch-ratersearch-evaluation-analyst
Search Engine Evaluator - English (Nigeria)Open
RWS Group·Nigeria·USD 6 / hourly
search-quality-raterai-evaluatorsearch-engine-evaluatorai-data-annotatorweb-search-evaluatorentry-level-search-engine-evaluator
Search Engine Evaluator - Norwegian (Norway)Open
RWS Group·Norway·USD 23 / hourly
search-engine-evaluatorsearch-quality-raterai-evaluatordata-annotatorsearch-quality-analystentry-level-search-engine-evaluator
AI Data QA & Training SpecialistOpen
SupportNinja·Philippines
ai-data-quality-specialistai-training-specialistdata-annotatorai-evaluatorqa-specialistai-training-data-specialist
Investment & Finance Expert, RemoteOpen
Xperteez Technology·Worldwide·USD 245 - 280 / hourly
financial-analystinvestment-analystfinance-expertinvestment-professionalai-evaluatorfinance
Healthcare Operations Specialist - Fully Remote | Upto $120/hrOpen
mercor·India·USD 80 - 120 / hourly
ai-evaluatorhealthcare-ai-specialistai-trainerhealthcare-quality-assuranceai-annotatorhealthcare-operations-specialist
Bilingual Language Model EvaluatorOpen
mercor·United States·USD 15 - 20 / hourly
bilingual-evaluatorlanguage-model-evaluatorai-evaluatordata-annotatorcontent-evaluatorbilingual-ai-evaluation
AI Safety Practitioner - Expert EvaluatorOpen
mercor·Denmark·USD 60 - 70 / hourly
ai-safety-specialistai-safety-practitionertrust-and-safety-analystai-evaluatorcontent-moderatorai-safety-evaluator
Compliance AI Evaluator - FinanceOpen
mercor·Canada·USD 80 - 120 / hourly
ai-evaluatorcompliance-evaluatorai-auditorfinancial-compliance-specialistqa-specialistai-compliance-evaluator
Data Evaluator - Fully Remote | Upto $120/hrOpen
mercor·Australia·USD 80 - 120 / hourly
ai-evaluatordata-evaluatorai-trainerai-quality-assuranceprompt-engineerdata-evaluation-analyst
Experiment Readiness Specialist - Fully Remote | Upto $120/hrOpen
mercor·United States·USD 80 - 120 / hourly
ai-evaluatorcontent-evaluatorai-trainersubject-matter-expertquality-assurance-evaluatorexperiment-readiness-specialist

Remote Ai Evaluator jobs: what to know

RemoShift tracks 76 live remote ai evaluator roles, refreshed every 30 minutes — every listing links straight to the original posting. Current openings come from Himalayas and include mercor, Welocalize, Innodata and RWS Group plus other employers hiring this week.

Common openings right now include “AI Safety Specialist - Evaluation Expert”, “Compliance AI Evaluator - Finance” and “Financial Compliance AI Evaluator”. By current openings, these roles hire mostly in the USA (33), Canada (6) and the UK (6). 4% (3 listings) are flagged work-from-anywhere — open to candidates in any country; the rest expect timezone overlap with the hiring team's region.

The seniority mix runs mid (75) and junior (1), so the market skews toward mid roles — 99% of the current set. Pay is disclosed on only a minority of listings — use the has-salary filter to see the ones that publish a range.

Live roles
76 live remote ai evaluator jobs
Top employers
mercor, Welocalize, Innodata, RWS Group, Lifted (an Upwork Company) and micro1
Common locations
the USA, Canada and the UK
Remote policy
4% work-from-anywhere
Seniority mix
mid (75) and junior (1)
Data sources
Himalayas

Frequently asked questions

How much do remote ai evaluator jobs pay?
Pay varies by employer, region and seniority, and only a minority of remote ai evaluator listings publish a range — use the has-salary filter to see those first. Where no range is listed, the original posting states the comp structure; expect the band typical for the role and region.
Are remote ai evaluator jobs open to candidates anywhere?
4% of current remote ai evaluator listings are work-from-anywhere, so you can apply from any country. The remainder are remote-within-a-region or require timezone overlap — currently concentrated in the USA, Canada and the UK. Read the original posting for the exact rule.
What seniority levels hire for remote ai evaluator roles?
Current listings skew mid (75) and junior (1) — mid roles alone are 99% of the set. Use the seniority filter to narrow the live list, and check each posting for the exact band and any experience floor.

Explore related pages

All remote data science jobsBrowse all remote jobsRemote work guides

Browse by function