Epistemic status: an explainer plus a modest claim about oversight. The technical facts are from public papers and model cards (linked); the oversight argument is my view, not a result.
Looped transformers rerun a shared block of layers several times per token, so a model can compute more deeply without more parameters. The idea is old (Adaptive Computation Time in 2016, Universal Transformers in 2018), but 2025–26 brought it into released language models. NVIDIA's 4B Dory stores 36 layers and executes 96 when its 20-layer core loops four times; with two or more loops its authors report better average results than selected larger models on 12 benchmarks (paper).
The weights stay fixed during these passes. Only the hidden state changes. This is extra computation on the current request, not learning, and not recursive self-improvement: nothing persists to the next request.
Chain-of-thought reasoning puts intermediate steps into text. That text is imperfect evidence. It isn't guaranteed to match what the model actually computed. But it can be read, logged and audited.
Looping does its intermediate work in activations. There's no transcript. As more capability comes from internal passes rather than written steps, a smaller share of the reasoning is available to read at all.
Two inferences I'd resist:
My view is that more capable internal computation raises the value of external checks. For code, that means tests and execution traces. For a calculation, an independent recomputation. For a decision, checks proportional to the cost of being wrong. When the reasoning can't be read, the outcome has to be checked.
There's a useful complement: looping adds computation, not information. A model can't loop its way to a fact that isn't in its input or weights. That makes one class of error easier to anticipate: a confident answer to a question whose evidence was never available. That's a place where retrieval with citations, plus verification, does more than any amount of extra internal processing.
This post adapts the oversight section of a longer explainer I wrote, Looped Transformers Explained, originally published on piszczek.pl, which covers the architecture, evidence and costs in more detail, with interactive figures.
Disclosure: I drafted this with AI assistance, checked the facts against the linked sources, and the argument and questions are mine.