Jensen’s 1st X post - open models ( BULLISH for memory)
Closed models concentrate demand — one provider runs shared HBM pools in a handful of data centers, so memory usage is pooled and efficient (amortized across many users).
Open models multiply demand — every company that self-hosts the same model needs its own full copy of the weights and its own KV cache. 10,000 self-hosters means 10,000 separate HBM footprints instead of one shared pool.
With 128K–1M token contexts becoming standard in 2026, KV cache alone can top 40GB per active session — so replication gets expensive fast.
u/Pinkygirl7 — 1 day ago