Ep. 030 - Long Live the Short King: Why 4-HI HBM Wins (Memory) | Myron Xie, Jordan Nanos
▶ 2:24
And Nvidia, when they originally previewed Rubin Ultra to people at GTC last year, they said that the Rubin Ultra would have 1TB of HBM per package for chip.
▶ 18:14
they charge you for the capacity. So customers pay effectively on a dollar per gigabyte basis for HBM. That's how they price it. So you can have, but the bandwidth is same. So if you're paying for more capacity with 8-HI or 12-HI, you're paying much more, you're almost double or triple what you paid for the same cube of 4-HI HBM.
The whole Rubin having 192MB instead of 1T HPM