A minimal reproducing experiment that shows induction heads forming around step 4,100 — and why I don't think "grokking" is the right word.
ary / essays
essays.
long-form research & writing. sometimes finished, often not. the status tag tells you which.
// 2026 3 entries
2026-04-10 On the emergence of in-context learning in small transformers
2026-03-22 What Borges got right about library science
The library of Babel is not about libraries — it is about the moment you realize the map is the territory.
2026-02-14 A taxonomy of my own procrastination
Not all procrastination is the same. I'm trying to learn which of my avoidances are signals and which are just noise.