← All sources
FOLLOWING / rikiyat.github.io

rikiyat.github.io

1 articles in your libraryVisit blog ↗

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

This article reports that a frontier LLM can read and write neural network weights without gradient descent. It identifies trained behaviors from raw weights, writes game-playing networks zero-shot, and edits a small share of a language model's weights to fix looping and raise math scores. Results are early; a model without looping defects could not be improved, showing limits of the method.