News
The open-source model that runs on a laptop and embarrassed the giants
A small research collective released a language model that matches last year’s commercial leaders while running on consumer hardware.
Technology columnist
6 min read
The model running offline on a three-year-old laptop.
The release came without a launch event, a waitlist or a blog post longer than four paragraphs. Within 48 hours, the model had been downloaded more than two million times.
It runs entirely on a laptop, needs no internet connection and, on several standard benchmarks, outperforms commercial systems that were state of the art a year ago.
Why it matters
Running AI locally changes the economics and the privacy calculus. No data leaves the device. No subscription is required. Businesses in regulated sectors, from health to law, have been waiting for exactly this.
“The moat was compute. The moat is gone,” one researcher wrote.
The caveats
Smaller models still struggle with long, complex reasoning, and safety testing by volunteers is less rigorous than at large labs. Regulators have yet to decide how rules written for big providers apply to software anyone can download.
Topics
Ines Okafor
Technology columnist
Ines writes about technology and power, and who gets to decide what the machines are for.
