GSPO
AssessTechniques
A reinforcement learning objective used in the experiment described in the article.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by framework updates, with 0 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 7Hugging Face Blog·5/6/2026framework_updatevLLM V1 Migration: Fixing Rollout Logprobs Before RL Objective Changes
Hugging Face describes a migration from vLLM V0 to V1 in an RL training pipeline, where mismatched rollout logprobs initially changed training behavior. The team restored parity by enabling processed logprobs, adjusting V1 runtime defaults, fixing the inflight weight-update path, and using an fp32 lm_head before considering any RL objective corrections.