DBRX: The new best open LLM and Databricks' ML strategy
March 29, 2024
16 min
18 of 156

March 29, 2024
DBRX: The new best open LLM and Databricks' ML strategy
0:00 / 16:32
Excerpt playback isn’t available for this episode — use the full-episode link.
Search the Record
Moment search isn’t open for this episode yet
When it opens, you’ll be able to type any phrase and jump straight to the second it was said.
Nathan Lambert Episodes Around March 29, 2024
Episode 18 of 156 — walk the feed in the order it was published.
16:32This episodeDBRX: The new best open LLM and Databricks' ML strategy
Summary
<p>Databricks' new model is surpassing the performance of Mixtral and Llama 2 while still being in a size category that's reasonably accessible.<br />This is AI generated audio with Python and 11Labs.<br />Source code: <a class="linkified" href="https://github.com/natolambert/interconnects-tools" target="_blank">https://github.com/natolambert/interconnects-tools</a><br /><a class="linkified" href="https://www.interconnects.ai/p/databricks-dbrx-open-llm" target="_blank">https://www.interconnects.ai/p/databricks-dbrx-open-llm</a></p><p>00:00 DBRX: The new best open model and Databricks' ML strategy<br />03:36 The DBRX narrative<br />07:33 Databricks' open LLM (and AI) strategy<br />09:42 Playing with DBRX Instruct<br />14:54 Digging for details</p><p>Fig 1: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_007.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_007.png</a><br />Fig 2: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_012.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_012.png</a><br />Fig 3: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_023.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_023.png</a><br />Fig 4: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_045.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_045.png</a><br />Fig 5: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_047.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_047.png</a><br />Fig 6: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_059.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_059.png</a><br />Fig 7: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_066.jpeg" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_066.jpeg</a><br />Fig 8: <a class="linkified" href="https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_068.png" target="_blank">https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/dbrx/img_068.png</a></p> <br /><br />This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit <a href="https://www.interconnects.ai/subscribe?utm_medium=podcast&utm_campaign=CTA_2">www.interconnects.ai/subscribe</a>





























