Blog

A close reading of arXiv:2608.31046. Teacher supervision disagrees with ground truth 50.6% of the time at 235B and the student converges anyway. Why the advantage measures confidence rather than correctness, what is left when you delete the teacher, and the comparison that calibrates the headline number.

A working Triton and a working Helion in ~4,000 lines of Python: NVRTC instead of MLIR, one register-layout rule that buys most of the performance, raw tensor-core PTX, and an autotuner that cannot ship a wrong kernel. Memory-bandwidth parity with Triton and ~92% of its cold matmul. On PyPI.

How I placed 29th of 1000+ in the SAIR Foundation (Terence Tao, Damek Davis) Mathematics Distillation Challenge: a two-phase decision procedure for equational implication over magmas, on the accuracy-cost-size frontier.

INT4, INT8, GPTQ, AWQ, QLoRA - a practical breakdown of the quantization methods reshaping how we deploy LLMs, plus the story behind building an interactive gallery to explore them.

How Google compresses the KV cache by 6× with zero accuracy loss - random rotation, per-element quantization, and QJL residual correction explained. Presented at ICLR 2026.

Program synthesis, test-time training, fluid intelligence - what makes ARC-AGI the hardest benchmark in AI, and my early experiments competing in it with a random agent baseline.

Google's two new research agents - one for automated figure generation, one for AI-assisted peer review. What they get right, what they miss, and why novelty evaluation is still a hard problem.