THE COLLECTION

Library

Everything you’ve found. Nothing you need to save twice.

4 articles
Browse at your own pace.

MATS Applications Open (Due Aug 29) — Neel Nanda

This is a recruitment call for the MATS mechanistic interpretability program run by Neel Nanda. Applicants complete a 12-20 hour research task and write-up by August 29. About 32 candidates enter a 5 week paid online phase, then about 8 enter a 12 week paid in-person phase writing a paper. The author says past scholars often publish at top ML venues.

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

This article reports that a frontier LLM can read and write neural network weights without gradient descent. It identifies trained behaviors from raw weights, writes game-playing networks zero-shot, and edits a small share of a language model's weights to fix looping and raise math scores. Results are early; a model without looping defects could not be improved, showing limits of the method.