Open models on local hardware

Pick a GPU, Mac or mini PC and see which of 110 open models fit in its memory, at what quantization, and roughly how many tokens per second it will decode.

131 machines · 110 models · data 2 November 2026 · speeds labelled by source

Pick your machine on the left, or start with one of these.

Popular comparisons

Build your own

A model fits when its weights, plus a margin for the runtime and an 8K-token context, fit in the memory your machine gives it. Speed is capped by memory bandwidth, because each new token reads the active weights once. Method and sources