Post

Conversation

Say what you will about Americaโ€™s struggles to build in the physical world (they are real and I do not discount them), but the fact that both these facilities scarcely existed 12-18 months ago is remarkable.
Quote
Lisan al Gaib
@scaling01
Project Rainier: 1 million Trainium2 chips across 16 buildings (316.800 mยฒ) - 667 ExaFLOPS BF16 Stargate 1 Abilene: 450-460k GB200 across 8 buildings (356.800 mยฒ) - 1125 ExaFLOPS BF16
Image
Image
119.7K
Views
David Watson ๐Ÿฅ‘
Post your reply

I've heard you interviewed repeatedly and I believe you mean everything you say about AI earnestly. And I also think overinvestment in data centers has a better than even chance of blowing up our economy. Even now, the cost of GPU rentals is way below operating cost.
I donโ€™t believe anything I have ever said, including this tweet, precludes the idea that we are in a bubble with potential bad consequences when it pops.
There are tons of other examples of the U.S. executing mega construction projects quickly. If you only focus on nuclear power plants and NYC and California things look bleak.
Image
In a way this is even more maddening. "We only build with bits, not atoms." "Not true! We build great with atoms, as long as they're used for bits." "..."
concrete grows faster when you feed it GPUs, jokeโ€™s on us
Itโ€™s amazing whatโ€™s possible in the hands of the private sector and with bureaucracy out of the way Meanwhile, one lane on the SF bay bridge east span has been periodically closed for over 2 years for who the fk knows
America's struggles to build always and only come in two varieties: governments being incompetent building infra and blue municipalities making construction impossible. A private firm building a megastructure in the desert? Oh yeah we can do that.
For some reason America can do shale and data centers but not other types of construction
The CHIPS act + all the new investments in american AI infrastructure might actually prove beneficial even after the bubble inevitably pops
Except we literally only do this when rich people stand to profit. The fact that we can do this means we can do many other things quickly.
The speed at which these ExaFLOPS-scale clusters (Rainier, Stargate) are deployed shows that time-to-compute is the most critical competitive advantage.
Amazing what you can achieve without Davis-Bacon imposing Democrat wreckers and extortion on your construction projects.