Skip to the card

Card 381 of 9992026-08-27 issue

Observed arrival · 2026-08-27

How Quant, Where the GPU Actually Goes

howquant.dev Observed source
Editorial interest 86/100 Selection signal · not a rating of the site

A technical field guide to local AI inference, GPU memory, Linux hardware, and measured llama.cpp performance.

Landing page captured for the 2026-08-27 issue.

Field notes

How Quant organizes local-inference work around reproducible hardware details rather than broad AI commentary. Its visible material includes ROCm 7.14 installation and verification, Vulkan/RADV setup, llama.cpp options, and tests of memory and PCIe behavior. The GPU-fit calculator distinguishes exact GGUF sizes from parameter-based estimates, while benchmark entries identify hardware, model variants, software revisions, and measurement dates.

Observed signals

Read the marks

Editorial observations of this landing page, not a rating.

OpenPublic substance visible
PrettyNotable craft visible
ProPolished or operationally mature
NicheUnusually specific use

One card from the complete issue

Karunia Goes to Press

307,705 arrived 1,000 judged 999 catalogued Enter the complete issue
howquant.dev

Landing page observed 2026-08-27. The live site may have changed.