Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights
This article reports that a frontier LLM can read and write neural network weights without gradient descent. It identifies trained behaviors from raw weights, writes game-playing networks zero-shot, and edits a small share of a language model's weights to fix looping and raise math scores. Results are early; a model without looping defects could not be improved, showing limits of the method.