Inkling on Two DGX Sparks: The Only vLLM Lane, and the Two Walls Behind It

Fri, 04 Sep 2026 23:00:00 +0200

Thinking Machines shipped Inkling-Small at the end of July: a ~300B-total, ~10B-active hybrid MoE (short-conv plus relative-bias attention), natively multimodal, 1M context, and - the part that matters for homelab hardware - released as NVFP4 from day one. 170.7 GB of weights. Two DGX Sparks hold 243 GB of unified memory. You can see where this is going.

For five weeks, though, every Spark recipe for it - drowzeys’ champion image, MiaAI’s wrapper, and the half-dozen forks - ran on SGLang with a custom-baked image, for a simple reason: SGLang had Inkling support in early August, and vLLM only gained it this week, in v0.28.0. The engine we build everything on could not even load the model before Monday.

Hotfix on Matt Suiche

Inkling on Two DGX Sparks: The Only vLLM Lane, and the Two Walls Behind It