Skip to the card

Card 381 of 9992026-08-27 issue

Observed arrival · 2026-08-27

How Quant, Where the GPU Actually Goes

howquant.dev Observed source
Editorial interest 86/100 Selection signal · not a rating of the site

A technical field guide to local AI inference, GPU memory, Linux hardware, and measured llama.cpp performance.

Landing page captured for the 2026-08-27 issue.

Field notes

How Quant organizes local-inference work around reproducible hardware details rather than broad AI commentary. Its visible material includes ROCm 7.14 installation and verification, Vulkan/RADV setup, llama.cpp options, and tests of memory and PCIe behavior. The GPU-fit calculator distinguishes exact GGUF sizes from parameter-based estimates, while benchmark entries identify hardware, model variants, software revisions, and measurement dates.

Observed signals

Read the marks

Editorial observations of this landing page, not a rating.

○OpenPublic substance visible
✦PrettyNotable craft visible
●ProPolished or operationally mature
◎NicheUnusually specific use

One card from the complete issue

Karunia Goes to Press

307,705 arrived 1,000 judged 999 catalogued Enter the complete issue
howquant.dev

Landing page observed 2026-08-27. The live site may have changed.