← robin stethem

an open notebook / 01

learning machines

Small experiments for understanding what happens inside a model. Pull on a parameter. See what changes.

01 / attention and memory

How much does a model need to keep?

One approach keeps everything the model has seen. Another keeps only a small running summary. The choices in between are the interesting part.

Interactive teaching illustration · runs in your browser, no live model