Latent Space: The AI Engineer Podcast — Why you should write your own LLM benchmarks — with Nicholas Carlini, Google DeepMind

BUZZING· 71%1h 10m·2024-08-29·Technology

Why you should write your own LLM benchmarks — with Nicholas Carlini, Google DeepMind

Latent Space: The AI Engineer Podcast

Today's guest, Nicholas Carlini, a research scientist at DeepMind, argues that we should be focusing more on what AI can do for us individually, rather than trying to have an answer for everyone. "How I Use AI" - A Pragmatic Approach Carlini's blog post "How I Use AI" went viral for good reason. Instead of giving a…

Listen now

Buzzmeter · cross-platform

71%

BUZZING

Active swarm energy. Strong reception, real community buzz.

Hive Vote · Skep listeners

New on SkepAwaiting the hive's first votes

Buzzmeter says it's buzzing across platforms — the Hive Vote says whether the people who actually listened liked it.

Rate this episode

Add your vote to the Hive — listeners rate every episode after they finish.

Recent reviews

No reviews yet — be the first.

Why you should write your own LLM benchmarks — with Nicholas Carlini, Google DeepMind

Rate this episode

More from Latent Space: The AI Engineer Podcast

Why AI Infrastructure must evolve for Agent Experience — Akshat Bubna, Modal CTO

🔬Doing Vibe Physics — Alex Lupsasca, OpenAI

🔬 Training Transformers to solve 95% failure rate of Cancer Trials — Ron Alfa & Daniel Bear, Noetik