September 10, 2026
A working intuition for diffusion on SO(3)
Why rotations make a useful case study for respecting geometry in generative models.
diffusiongeometrySO(3)scientific ML
Technical writing
Writing
Long-form notes on the concepts and implementation details that matter in machine learning systems.
August 28, 2026
MHA, MQA, and GQA: the cache is part of the architecture
A compact comparison of attention variants through the lens of inference-time memory.
transformersinferencesystems