English Linguistic Expert - Evaluator

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: English Language and Literature Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Role Responsibilities

- Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.

- Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.

- Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.

- Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance .

- Provide detailed linguistic feedback and analysis to guide ongoing model training efforts .

Qualifications

Must-Have

- Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.

- Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.

- Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.

- Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.

- Strong attention to detail, analytical judgment, and written communication skills.

- Ability to work independently in a distributed, remote environment .

Preferred
- Interest in AI and LLM-driven language technologies .

Application Process (Takes 20–30 mins to complete)

- Upload resume

- AI interview based on your resume

- Submit form

Resources & Support

- For details about the interview process and platform information, please check:

- For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas