SentinelA new way to search
Sign Up
Nathan Lambert
Nathan Lambert
@natolambert·8K subscribers·27 videos

DPO Debate: Is RL needed for RLHF?

Posted

December 1, 2023

Views

10,389

Likes

276

Comments

8

Engagement

2.73%

Search the Record

Indexed

Every word spoken in this episode is indexed. Type any phrase to jump straight to the moment it was said.

Type any word or phrase that may have been spoken. Click a result to seek the player to that exact moment.

Try a name, a topic, or a quoted line

Nathan Lambert Episodes Around December 1, 2023

See what was published immediately before and after this episode.

12:38

[Talk] Industry Review Talk: Machine Learning for Microsystem Control

Apr 9, 2022·100 views
36:23

[Talk] Dissertation Talk: Synergy of Prediction and Control in Model-based Reinforcement Learning

Apr 16, 2022·339 views
1:01:22

[Talk] Planning through Exploration and Exploitation in Model-based Reinforcement Learning

Apr 25, 2022·822 views
2:50

Reward Reports Brief Intro

Jul 18, 2022·100 views
47:39

[Unlisted Talk] Objective Mismatch in Reinforcement Learning from Human Feedback

Aug 28, 2023·58 views
26:55Now Playing

DPO Debate: Is RL needed for RLHF?

Dec 1, 2023·10.4K views
17:24

15min History of Reinforcement Learning and Human Feedback

Dec 15, 2023·4K views
16:50

Introducing RewardBench: The First Benchmark for Reward Models (of the LLM Variety)

Mar 20, 2024·1.4K views
20:44

Open-source AI (and LLMs): Definitions, Finding Nuance, and Policy

Apr 1, 2024·740 views
13:23

An update on DPO vs PPO for LLM alignment

Jul 22, 2024·4.1K views
15:51

Self-directed Synthetic Dialogues (and other recent synth data)

Jul 31, 2024·1.3K views
View all episodes
YouTubeWebsiteSpotifyApple Podcasts

YouTube Description

as posted by the channel

All things as we cannot settle if DPO or RL is better. At least it is a good exercise.

Recent blog post of mine on DPO

Links & Promotions

docs.google.com/presentation/d/1gCnS6Sv2ynER3…interconnects.ai/p/rlhf-progress-scaling-dpo-…arxiv.org/abs/2305.18290

Guests & Subjects Covered

DPO DebateSlides RecentDPO DPO Paper

Sentinel Indexing in Progress

Metadata and chapters are available. Claim extraction for this episode is pending.

All video content is delivered via YouTube embedded players in accordance with the YouTube Terms of Service. Sentinel provides research tools that promote discovery and accountability across political media.

← All episodes from Nathan Lambert
DPO Debate: Is RL needed for RLHF? · Nathan Lambert · Sentinel