Research Scientist, LLM Evaluation & Post-Training

🏢 OneForma · all 22 jobs
📍 United States
💰 USD 150,000 - 300,000 / annual
📅 Posted Sep 19, 2026 · via Himalayas
🏷 Research Scientist, LLM Evaluation, LLM Post Training, Machine Learning Research, AI Research, LLM Research Scientist +7 more
Apply on original site ↗

About Centific

Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the Magnificent Seven and our enterprise clients with safe, scalable AI deployment. Our team includes more than 150 PhDs and data scientists, along with more than 4,000 AI practitioners and engineers. We harness the power of an integrated solution ecosystem—comprising industry-leading partnerships and 1.8 million vertical domain experts in more than 230 markets—to create contextual, multilingual, pre-trained datasets; fine-tuned, industry-specific LLMs; and RAG pipelines supported by vector databases. Our zero-distance innovation™ solutions for GenAI can reduce GenAI costs by up to 80% and bring solutions to market 50% faster.

Our mission is to bridge the gap between AI creators and industry leaders by bringing best practices in GenAI to unicorn innovators and enterprise customers. We aim to help these organizations unlock significant business value by deploying GenAI at scale, helping to ensure they stay at the forefront of technological advancement and maintain a competitive edge in their respective markets.
About Job

Role: Senior Applied Reinforcement Learning Engineer

Location: Palo Alto, CA or Seattle, WA (Hybrid/Remote)
About the Team

Centific AI Research advances foundational AI models and applications through reinforcement learning, alignment, and human-centered intelligence. Our mission is to transform data, signals, and human insight into next-generation intelligent systems that redefine enterprise intelligence.

We're building a governed RL environment platform that enables enterprises to safely iterate and improve AI agent workflows through simulation-based learning, bridging human-labeled signal creation with automated RL training for high-stakes operations.
Role Overview

As an Applied RL Engineer, you will design and build RL environments that simulate complex enterprise workflows and train intelligent agents within them. You'll work at the intersection of RL research and production systems, translating customer requirements into bespoke simulation environments and post-training pipelines that deliver measurable improvements to AI agent performance.

This role requires deep expertise in both classical RL methodologies and modern LLM-based agent architectures. You'll shape our product direction and help make RL accessible to enterprise customers who need safe, compliant ways to improve their AI systems.
Core RL Competencies

Foundational RL

- MDPs & value methods: State/action spaces, Q-learning, DQN, Double DQN, Dueling DQN

- Policy gradient methods: REINFORCE, Actor-Critic, A2C/A3C, variance reduction

- Advanced optimization: PPO, TRPO, SAC, trust regions, entropy regularization

- TD learning: TD(0), TD(λ), eligibility traces, bootstrapping methods

LLM Alignment & Post-Training

- RLHF pipelines: Reward model training, preference learning, human feedback integration

- Direct optimization: DPO, IPO, KTO, offline preference optimization

- Group-based methods: GRPO, RLOO, sample-efficient policy improvement

- Reward modeling: Bradley-Terry models, reward hacking mitigation, KL constraints

Environment Design

- Gymnasium/OpenAI Gym: Custom environments, observation/action spaces, wrapper patterns

- Reward engineering: Sparse vs. dense rewards, potential-based shaping, intrinsic motivation

- Verifier design: Programmatic reward functions, outcome verification, ground-truth evaluation

- Simulation: Sim-to-real transfer, domain randomization, multi-agent dynamics

Advanced Techniques

- Offline RL: CQL, BCQ, IQL for learning from fixed datasets without environment interaction

- Model-based RL: World models, Dreamer, MuZero, learned dynamics

- Hierarchical RL: Options framework, goal-conditioned policies, temporal abstraction

- Imitation & exploration: Behavioral cloning, GAIL, curiosity-driven exploration, UCB

Key Responsibiliti

Flights + hotels

This role requires you to be in the United States. If that means relocating or flying in, it is worth checking fares before you commit to a start date.

Compare flights and hotels →

← All remote jobs

Comparing Data Scientist pay and openings — the live median is $140k?All remote Data Scientist jobs →Data Scientist salary data →
Want more like this? Browse every live remote data science role.All remote data science jobs →
Get new data science jobs by email
Daily email, only when there's something new. One click to stop.

Get remote data science jobs like this by email

10 hand-picked jobs, one email a day. No spam, unsubscribe anytime.

Similar for you