An FPGA with the weights in memory and a wire looping output back to input could just sit there, executing SUBLEQ programs. Just a transformer being a transformer being a computer.
大多数人认为计算机需要复杂的CPU架构和操作系统,但作者认为一个简单的FPGA加上循环连接的transformer权重就可以构成一个完整的计算机。这挑战了我们对计算机本质的理解,暗示transformer架构可能比传统CPU更接近计算的本质。