Latent Space: The AI Engineer Podcast — LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML

SCOUT· 60%52m·2023-08-10·Technology

LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML

Latent Space: The AI Engineer Podcast

We have just announced our first set of speakers at AI Engineer Summit! Sign up for the livestream or email sponsors@ai.engineer if you’d like to support. We are facing a massive GPU crunch. As both startups and VC’s hoard Nvidia GPUs like countries count nuclear stockpiles, tweets about GPU shortages have become…

Listen now

Buzzmeter · cross-platform

60%

SCOUT

Scout bees are checking it out — divided opinions, the swarm hasn't committed.

Hive Vote · Skep listeners

New on SkepAwaiting the hive's first votes

Buzzmeter says it's buzzing across platforms — the Hive Vote says whether the people who actually listened liked it.

Rate this episode

Add your vote to the Hive — listeners rate every episode after they finish.

Recent reviews

No reviews yet — be the first.

LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML

Rate this episode

More from Latent Space: The AI Engineer Podcast

Why AI Infrastructure must evolve for Agent Experience — Akshat Bubna, Modal CTO

🔬Doing Vibe Physics — Alex Lupsasca, OpenAI

🔬 Training Transformers to solve 95% failure rate of Cancer Trials — Ron Alfa & Daniel Bear, Noetik