Open source

Running your own AI model used to be a project for people with a spare graphics card and a weekend to lose. In 2026 it is closer to installing an app. Here is the calm, no-hype version of how to get a genuinely useful model running on your own machine, and honest expectations about what it will and will not do.

DeepSeek V4 arrived in April with the same trick DeepSeek always pulls: numbers that should cost a fortune, at prices that do not. Top-tier coding scores, a million-token context, an MIT license, and output priced under a dollar per million tokens. The West still has not quite made peace with it.

Gemma 4 12B is not going to top any leaderboard, and reviewing it against the frontier would miss the point entirely. The question that matters is different: how much useful AI can you now run entirely on your own laptop, with the internet unplugged? The answer, it turns out, is a surprising amount.

Every month brings a new open model, and most are footnotes. GLM-5.2 is not. Z.ai released a 753-billion-parameter model, with a one-million-token context window, under a plain MIT license. That last part is what makes it matter.

Llama 4 Scout is easy to review badly. You quote the ten-million-token context window, call it revolutionary, and move on. Having actually run it, the honest review is more interesting, and more useful: Scout is a very good open model whose best feature is not the one on the box.

Meta Llama 4 family landed with a headline number that is hard to ignore: Scout, the smaller variant, offers a ten-million-token context window. That is the largest of any model, open or closed. It is also a feature most people quoting it will never actually use.

Most model releases are the same recipe made a little bigger. NVIDIA Nemotron 3 Ultra is a bit more interesting, because it quietly does something different under the hood. It is a 550-billion-parameter model built on a hybrid of Mamba and Transformer architectures, and that architectural choice is the actual story, not the benchmark line.

There was no dramatic moment, no single announcement, no headline that said it plainly. But somewhere in 2026, without a parade, open-weight models stopped being the scrappy underdog and became the default sensible choice for a huge slice of real work. It was a quiet war, and the open side won more of it than anyone expected.

Everyone reviews the frontier. Almost nobody carefully reviews the budget shelf, which is a shame, because that is where most real work should actually run. I spent time putting the cheap models through the same ordinary tasks I use every day. The winner was not the one I expected, and the losers were instructive.

Quietly, without a single headline capturing it, the cost of using capable AI collapsed this year. Not dropped. Collapsed. The kind of model that cost a small fortune to run at scale two years ago now costs cents per million tokens. If your business plan assumed AI would stay expensive, it is time to redo the math.

June and early July gave us a model release almost every day, which is exactly why you should not try to follow all of them. Most were incremental. A few will still matter next summer. Here is the month sorted the only way that is useful: by how long it will stay relevant.