Each loop iteration is the functional equivalent of one step of chain-of-thought, but operating in continuous latent space rather than token space. A looped model running T loops implicitly simulates T steps of CoT reasoning. This has been formally proven (Saunshi et al., 2025).
这一发现令人惊讶，因为它表明循环模型在连续潜在空间中实现了思维链推理，而不需要显式的中间token输出。这意味着模型可以在单次前向传播中完成多步推理，这挑战了传统思维链需要显式token输出的观点，并为理解大模型推理过程提供了新视角。
think of lat space as similar to what humans have with like 00:24:30 abstract ideas or if you ever have some intuition about something that you can't fully put into words
for - definition - latent space
definition - latent space
adjacency - between - latent space - tacit awareness in the indyweb - adjacency statement - Latent space is similar to the concept of tacit awareness in the Indyweb
Liu, Andrew, and Mason A. Porter. ‘Spatial Strength Centrality and the Effect of Spatial Embeddings on Network Architecture’. Physical Review E 101, no. 6 (9 June 2020): 062305. https://doi.org/10.1103/PhysRevE.101.062305.