DRAM Crunch: Lessons for System Design
eetimes.com53 points by giuliomagnifico 2 days ago
53 points by giuliomagnifico 2 days ago
The weak link in the argument is the "1-2 GB DRAM stays stable" claim. That tier is stable because demand sits elsewhere. If AI workloads actually migrate down-capacity at scale (which is what the piece advocates), pricing pressure follows them.
This is what keeps Amodei and Altman up at night. Their whole moat is data centers. But what if we didn't need the data centers?
This article is an ad for Hailo and frontier AI will never run on the edge so A & A have nothing to worry about.
(I define frontier AI as that which doesn't run on the edge... gotcha.)
[flagged]