Technical Experts needed to stump AI Models

🏢 Lifted, an Upwork Company™ · all 225 jobs
📍 Remote, US
📅 Posted Oct 6, 2026 · via SmartRecruiters
✅ Verified open — last confirmed 18h ago
Apply on original site ↗

This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback.

Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.

The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.

Who we need:
- Masters degree or higher
- 10+ years of professional experience in a technical domain
- At least one publication (academic or professional)

Domains in demand:
- Coding
- Machine Learning
- Systems
- Security
- Hardware

- This is an ongoing project — at least 7 weeks
- Onboarding process is approximately 90 minutes total

Flights + hotels

This role requires you to be in the United States. If that means relocating or flying in, it is worth checking fares before you commit to a start date.

Compare flights and hotels →

← All remote jobs

Get new remote jobs like this by email
Daily email, only when there's something new. One click to stop.

Get remote other; staffing and recruiting jobs like this by email

10 hand-picked jobs, one email a day. No spam, unsubscribe anytime.

Similar for you