Latent Space: The AI Engineer Podcast — State of the Art: Training >70B LLMs on 10,000 H100 clusters

SCOUT· 69%1h 21m·2024-06-25·Technology

State of the Art: Training >70B LLMs on 10,000 H100 clusters

Latent Space: The AI Engineer Podcast

It’s return guest season here at Latent Space! We last talked to Kanjun in October and Jonathan in May (and December post Databricks acquisition): Imbue and Databricks are back for a rare treat: a double-header interview talking about DBRX from Databricks and Imbue 70B, a new internal LLM that “outperforms GPT-4o”…

Listen now

Buzzmeter · cross-platform

69%

SCOUT

Scout bees are checking it out — divided opinions, the swarm hasn't committed.

Hive Vote · Skep listeners

New on SkepAwaiting the hive's first votes

Buzzmeter says it's buzzing across platforms — the Hive Vote says whether the people who actually listened liked it.

Rate this episode

Add your vote to the Hive — listeners rate every episode after they finish.

Recent reviews

No reviews yet — be the first.

State of the Art: Training >70B LLMs on 10,000 H100 clusters

Rate this episode

More from Latent Space: The AI Engineer Podcast

Why AI Infrastructure must evolve for Agent Experience — Akshat Bubna, Modal CTO

🔬Doing Vibe Physics — Alex Lupsasca, OpenAI

🔬 Training Transformers to solve 95% failure rate of Cancer Trials — Ron Alfa & Daniel Bear, Noetik