Podcast · 156 episodes on record

AGI is what you want it to be

Published

April 24, 2024

Length

10 min

Position

23 of 156

April 24, 2024

AGI is what you want it to be

0:00 / 10:38

0:00Choose a match or chapter to light up its moment10:38

Listen to the full episode

Excerpt playback isn’t available for this episode — use the full-episode link.

Search the Record

Moment search isn’t open for this episode yet

When it opens, you’ll be able to type any phrase and jump straight to the second it was said.

Nathan Lambert Episodes Around April 24, 2024

Episode 23 of 156 — walk the feed in the order it was published.

View all episodes

10:18

Alignment-as-a-Service: Scale AI vs. the new guys

Feb 7, 2024

7:44

Why reward models are still key to understanding alignment

Feb 14, 2024

9:07

Releases! OpenAI’s Sora for video, Gemini 1.5's infinite context, and a secret Mistral model

Feb 16, 2024

14:57

10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more

Feb 20, 2024

17:16

Google ships it: Gemma open LLMs and Gemini backlash

Feb 22, 2024

10:46

How to cultivate a high-signal AI feed

Feb 28, 2024

1:26:28

Interviewing Louis Castricato of Synth Labs and Eleuther AI on RLHF, Gemini Drama, DPO, founding Carper AI, preference data, reward models, and everything in between

Mar 4, 2024

23:06

10:38This episode

AGI is what you want it to be

Apr 24, 2024

9:46

Phi 3 and Arctic: Outlier LMs are hints

Apr 30, 2024

13:08

RLHF: A thin line between useful and lobotomized

May 1, 2024

14:05

OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions

May 13, 2024

12:28

OpenAI chases Her

May 16, 2024

9:03

Name, image, and AI's likeness

May 22, 2024

8:29

We aren't running out of training data, we are running out of open training data

May 29, 2024

7:49

A realistic path to robotic foundation models

Jun 5, 2024

12:35

AI for the rest of us

Jun 12, 2024

8:18

Text-to-video AI is already abundant

Jun 18, 2024

11:27

Frontiers in synthetic data

Jun 21, 2024

11:51

RLHF Roundup: Trying to get good at PPO, charting RLHF's impact, RewardBench retrospective, and a reward model competition

Jun 26, 2024

56:30

Interviewing Dean Ball on AI policy: CA SB 1047, upcoming AI disaster response, Llama 3 405B, Chinese open-source AI, and scaling laws

Jun 27, 2024

6:39

Switched to Claude 3.5

Jul 3, 2024

14:19

SB 1047, AI regulation, and unlikely allies for open models

Jul 17, 2024

15:22

Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem

Jul 23, 2024

View all episodes

Summary

Certain definitions of AGI are backing people into a pseudo-religious corner. This is AI generated audio with Python and 11Labs. Source code: <a class="linkified" href="https://github.com/natolambert/interconnects-tools" target="_blank">https://github.com/natolambert/interconnects-tools</a> Original post: <a class="linkified" href="https://www.interconnects.ai/p/agi-is-what-you-want-it-to-be" target="_blank">https://www.interconnects.ai/p/agi-is-what-you-want-it-to-be</a>00:00 AGI is what you want it to be 04:01 RL still rules the AGI discourse 05:43 Modern AGI tests 07:37 Agency and shifting goalpostsFig 1: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/agi/img_018.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/agi/img_018.png</a> Fig 2: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/agi/img_020.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/agi/img_020.png</a> This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit <a href="https://www.interconnects.ai/subscribe?utm_medium=podcast&utm_campaign=CTA_2">www.interconnects.ai/subscribe</a>

Episode details and artwork are published by the show’s own feed. Sentinel plays short cited excerpts and links every episode back to its publisher.

← All episodes from Nathan Lambert

AGI is what you want it to be

Search the Record

Nathan Lambert Episodes Around April 24, 2024

Alignment-as-a-Service: Scale AI vs. the new guys

Why reward models are still key to understanding alignment

Releases! OpenAI’s Sora for video, Gemini 1.5's infinite context, and a secret Mistral model

10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more

Google ships it: Gemma open LLMs and Gemini backlash

How to cultivate a high-signal AI feed

Interviewing Louis Castricato of Synth Labs and Eleuther AI on RLHF, Gemini Drama, DPO, founding Carper AI, preference data, reward models, and everything in between

The koan of an open-source LLM

Model commoditization and product moats

Evaluations: Trust, performance, and price (bonus, announcing RewardBench)

DBRX: The new best open LLM and Databricks' ML strategy

Why we disagree on what open-source AI should be

The end of the "best open LLM"

Stop "reinventing" everything to "solve" alignment

Llama 3: Scaling open LLMs to AGI

AGI is what you want it to be

Phi 3 and Arctic: Outlier LMs are hints

RLHF: A thin line between useful and lobotomized

OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions

OpenAI chases Her

Name, image, and AI's likeness

We aren't running out of training data, we are running out of open training data

A realistic path to robotic foundation models

AI for the rest of us

Text-to-video AI is already abundant

Frontiers in synthetic data

RLHF Roundup: Trying to get good at PPO, charting RLHF's impact, RewardBench retrospective, and a reward model competition

Interviewing Dean Ball on AI policy: CA SB 1047, upcoming AI disaster response, Llama 3 405B, Chinese open-source AI, and scaling laws

Switched to Claude 3.5

SB 1047, AI regulation, and unlikely allies for open models

Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem

Summary