1 essay · RSS

Writing

Essays, notes on papers I read, and things learned while building.

2026

22 OctHow Taco works: a language model, a range coder, and no floatsA course-style walk through Taco: why a likely token costs almost nothing, how a range coder turns probabilities into bytes, why float neural networks cannot be decoded on another machine, and how Taco runs GPT-2 with integers only, down to the bits of a float32.Essay23 min read