0. This is compaction (technical background) LLMs don’t experience time the way we do. We perceive the present not as an instant but as an extended present, a brief duration measuring about three seconds. But LLMs live in a massively extended present. When you talk to an LLM, it replays the entire session from the start each time before adding the next token (roughly, the next word). It does this over and over every time it reads and writes, meaning its extended present keeps

I recently got to listen to a jazz concert on the roof of Antoni Gaudí’s magnificent La Pedrera. Meet the building that teaches you how...