Naval (@naval)
@naval
0 正在关注 0 粉丝
You’re here because an unbroken chain of your ancestors, from tadpoles to monkeys to now, replicated.
Don’t be the first one to miss the branch.
One of the best recent podcasts on AI. Neil has a gift for explaining all of the jargon and insights simply.
(I’m not involved, just found it unusually educational).
Neil Movva (@neilmovva) started his career at Nvidia, working on GPUs and kernels, and has an unusually deep understanding of inference, from software to chips to power.
We spend a lot of time on each of those layers, how they connect, and where the important tradeoffs are.
What makes this conversation special is how detailed it is (like a 401-level class), yet Neil makes it remarkably clear and easy to follow.
Today he runs Sail Research, a company building infrastructure for agents to make tokens as cheap as possible.
We discuss:
- Latency versus throughput
- Why there are no bad chips, only bad pricing
- The end of kernel engineering
- Buying chips and power no one else wants
- New chip architectures
- Nvidia lore + his contrarian view of the company
- Open source and the frontier labs
I learned a ton. Enjoy!
TIMESTAMPS
0:00 Intro
0:38 Building a “Token Factory”
4:21 The Future of Background Agents
13:09 Nvidia and the GPU Stack
23:27 Chips, Memory, and Transformers
36:14 The Future of AI Training Data
44:32 Chip Scarcity and Compute Arbitrage
52:44 Reinventing the AI Data Center
59:01 Power and the “Scavenger Strategy”
1:10:10 Open vs. Closed AI
显示更多
To love is to gain joy from another’s well-being.
The time to be most ambitious is when you have nothing to lose or nothing left to gain.
Grok Bot is just cool. 😎
Of course an agent should be persistent.
Of course it should have its own computer.
All that remains is for it to be embodied…
If there were backdoors and biases hidden in open-weight models, you could count on closed-weight labs to find and reveal them.
Don’t sell anything you wouldn’t want your children to buy.
When software was expensive - thin, horizontal, best-of-breed software stacks extracted rents across every business.
Now that software is cheap - value moves to vertically integrated businesses that deliver opinionated end-to-end experiences.
显示更多
If the child loved the parents as much as the parents loved the child, their passing would be intolerable.
The problem with truth is, once you see it, you can’t unsee it.
Happy Birthday America, Land of the Free.
Don’t give up on the First, Second, Fourth, and Ninth Amendments.
They’re unique, and your freedom - and the worlds’ - depends on them.
If AI is doing the writing, it should do the reading too.
It's the Age of Builders.
(sorry financiers and talkers)
New podcast, new format. Three founders join us.
Waste Tokens, Save Time
00:00 Three Frontier Founders
01:27 AI Software Factories
04:15 Waste Tokens, Save Time
05:47 Models Instructing Humans
09:30 Is Pure Software Dead?
12:04 You Don't Get Stuck Anymore
With @rauchg, @maxhodak_, and @bscholl.
显示更多
The latest IQ test involves data centers and water.
