A Complete Guide to Shannon Information Theory
From surprisal, entropy, and mutual information to compression limits, channel capacity, coding theorems, and modern machine learning.
Writing / formed ideas
Things worth reading slowly.
Essays and technical writing with enough shape to be useful beyond the day they were published.
What Does Head Mixing in Coeff-Tuning Actually Solve?
A closer look at Coeff-Tuning's attention-head mixing, its toy example, and the boundary between what that experiment shows and what it does not.
Bouquet
Music as a fading bouquet: preserving emotion for memory while wearing it away with every replay.
Sleep
Passing through a door into memory and learning, somewhere between dream and the past, how to feel whole again.
The Garden
How a small garden below an apartment block became a forest, a field, a mine, and an entire childhood sky.
Yingze
A solitary autumn night in Yingze Park, searching for a moment of peace among the lake, pavilions, and scent of flowers.