Ep. 030 - Long Live the Short King: Why 4-HI HBM Wins (Memory) | Myron Xie, Jordan Nanos

…This in great detail sourced from a lot of work from the data center model that the guys have tracking sites, it's pretty clear to tell if a given site is targeted for pre-training or not [...] if you're going to have more than 100,000 GPUs in an individual building [...] that's a very different data center design compared to, you know, 2,000, 4,000, 8,000 GPUs spread across four data halls you know, it's clear that as the labs bring on more compute in a capacity-constrained world right now, that they are...…