Evaluators for AI training (English language)

🏒 TSMG · all 144 jobs
πŸ“ Ukraine
πŸ“… Posted Sep 21, 2026 Β· via Himalayas
🏷 AI Training, Content Moderation, Data Annotation, Quality Assurance, AI Training Evaluator, AI Trainer Evaluator +8 more
Apply on original site β†—

We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).
The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.
Full online training is provided.
The role is fully remote with the possibility of having a flexible schedule.
We are open to both full-time and part-time candidates.
Requirements:

- at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)

- attention to detail

- time-management skills

- proactive approach

- curious mind

Responsibilities:

- evaluate replies of the AI agent according to the provided guidelines

- recognize and evaluate differences between two possible responses to a request

- compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating

Originally posted on Himalayas

Flights + hotels

This role requires you to be in Ukraine. If that means relocating or flying in, it is worth checking fares before you commit to a start date.

Compare flights and hotels β†’

← All remote jobs

Want more like this? Browse every live remote developer role.All remote developer jobs β†’
Get new developer jobs by email
Daily email, only when there's something new. One click to stop.

Get remote developer jobs like this by email

10 hand-picked jobs, one email a day. No spam, unsubscribe anytime.

Similar for you