an open notebook / 03
learning machines
Small experiments for understanding what happens inside a model. Pull on a parameter. See what changes.
01 / tokens
What is a token?
How text goes in, and the next piece comes out.
Interactive teaching illustration · runs in your browser, no live model
02 / attention and memory
How much does a model need to keep?
One approach keeps everything the model has seen. Another keeps only a small running summary. The choices in between are the interesting part.
Interactive teaching illustration · runs in your browser, no live model
03 / manifolds and motion
How many dimensions does a movement need?
A volleyball, fourteen joints, and the smaller spaces hiding inside complicated machines.
Interactive teaching illustration · runs in your browser, no live model