GRPO's new variants and implementation secrets
March 24, 2025
9,667
394
12
4.20%
Search the Record
IndexedEvery word spoken in this episode is indexed. Type any phrase to jump straight to the moment it was said.
Type any word or phrase that may have been spoken. Click a result to seek the player to that exact moment.
Try a name, a topic, or a quoted line
Nathan Lambert Episodes Around March 24, 2025
See what was published immediately before and after this episode.
22:23Now PlayingGRPO's new variants and implementation secrets
YouTube Description
as posted by the channelOkay okay, spent my weekend gooning around learning GRPO / RL for lllms math. Here's some goods for you.
Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches, etc.
I know this format won't be for everyone, but I hope some of you love it!
DeepSeekMath paper
Where does ratio come from in PPO?
DAPO announcement
My DAPO recap
Dr. GRPO announcement
TRL GRPO implementation
Unbiased GRPO implementation
Thread on GRPO implementation on x
Guests & Subjects Covered
Sentinel Indexing in Progress
Metadata and chapters are available. Claim extraction for this episode is pending.
All video content is delivered via YouTube embedded players in accordance with the YouTube Terms of Service. Sentinel provides research tools that promote discovery and accountability across political media.