Model Internals, part 1: Proving LLM inference on Rust, CUDA, and Lean

Wed, 11 Nov 2026 00:00:00 +0100

Windows Internals taught a generation of systems people to stop treating the operating system as a black box: handles, objects, syscalls, memory, and the contracts between them. Model Internals is the same exercise for modern AI systems. Weightproof is part 1 because the interesting security property is not a bigger model or a faster token counter; it is knowing exactly which weights, traces, tables, instructions, and proof obligations produced a token.

ICICLE on Matt Suiche

Model Internals, part 1: Proving LLM inference on Rust, CUDA, and Lean