Context Is Software, Weights Are Hardware

DRANK

Both KV cache and weights modulate activations. Context is software running on frozen hardware. Weight updates redesign the hardware itself. The difference matters more than most people think.