Latent Space: The AI Engineer Podcast — In the Arena: How LMSys changed LLM Benchmarking Forever

BUZZING· 78%41m·2024-11-01·Technology

In the Arena: How LMSys changed LLM Benchmarking Forever

Latent Space: The AI Engineer Podcast

Apologies for lower audio quality; we lost recordings and had to use backup tracks. Our guests today are Anastasios Angelopoulos and Wei-Lin Chiang, leads of Chatbot Arena, fka LMSYS, the crowdsourced AI evaluation platform developed by the LMSys student club at Berkeley, which became the de facto standard for…

Listen now

Buzzmeter · cross-platform

78%

BUZZING

Active swarm energy. Strong reception, real community buzz.

Hive Vote · Skep listeners

New on SkepAwaiting the hive's first votes

Buzzmeter says it's buzzing across platforms — the Hive Vote says whether the people who actually listened liked it.

Rate this episode

Add your vote to the Hive — listeners rate every episode after they finish.

Recent reviews

No reviews yet — be the first.

In the Arena: How LMSys changed LLM Benchmarking Forever

Rate this episode

More from Latent Space: The AI Engineer Podcast

Why AI Infrastructure must evolve for Agent Experience — Akshat Bubna, Modal CTO

🔬Doing Vibe Physics — Alex Lupsasca, OpenAI

🔬 Training Transformers to solve 95% failure rate of Cancer Trials — Ron Alfa & Daniel Bear, Noetik