A 150M parameter model hitting 29.5% on ARC-AGI-1 is wildly impressive

A 29.5% score on ARC-AGI-1 normally belongs to enormous models or prohibitively expensive compute setups, yet this new paper from the Pathway team reports a 150M parameter model reaching that result for about $0.0007 per task. The score is striking, but the more unusual detail is that the system is not a transformer.

How does recurrent latent reasoning work?

The model uses a recurrent latent reasoning setup. Rather than predicting standard token-by-token output, it operates in latent space, moving through internal states before producing a final answer. This offers a closer look at how complex reasoning might be achieved without a trillion parameters or a massive GPU cluster. At this size, the model could practically run on a toaster, yet it appears to sit entirely outside the current cost-to-accuracy frontier for the ARC-AGI benchmark.

Latent reasoning matters because most current AI workflows depend on the transformer architecture, which is powerful but computationally demanding. This recurrent approach points to a different possibility: a model could work through a problem internally, giving itself “time to think” without generating intermediate text, and potentially solve logic puzzles that challenge smaller models. It is another way to approach “system 2” thinking.

What does this mean for LLM agents?

For anyone involved in prompt engineering or building LLM agents, this suggests that progress may depend not only on bigger models, but also on more efficient internal architectures. When a model this small performs so far beyond its expected range, scaling the architecture raises an obvious question about what it could achieve at larger sizes.

I would not announce the death of the transformer yet, but if this approach reaches 1B or 3B parameters, the efficiency improvements could be enormous. The possibility includes local deployment of high-reasoning models that do not consume substantial battery power or require a $40k H100.

The technical paper from Pathway is available on arXiv:

https://arxiv.org/abs/2608.09888

Is the balance of parameter count changing?

The balance between parameter count and reasoning capability is changing. As researchers pursue the next 10-trillion parameter behemoth, smaller recurrent systems may offer a more deployable path toward real-world AGI. Whether this method generalizes beyond ARC or is specifically effective for its grid-logic structure remains to be seen.