Research Safety & ethics Infrastructure & hardware

AI’s hidden storage bill: What inference leaves behind

MIT Technology Review Tim Rausch

Publication summary. The terms of MIT Technology Review do not allow reproduction of the full article: read the complete text on the original website.

Source summary (English)

Ask most executives to picture the cost of AI and they’ll likely see GPUs—racks of accelerators with gigawatts of power—and a waitlist for silicon. But that picture leaves something out: Data storage costs. What happens to data after a model responds? Much of the back-end data that’s generated—from billions of daily prompts, images, and videos—needs…

Read the full article

www.technologyreview.com

View on MIT Technology Review (new tab)

Topics

Share

X (new tab) LinkedIn (new tab) Facebook (new tab) Email

Related articles