Quantization on Bits-Entangledhttps://stondo.github.io/tags/quantization/Recent content in Quantization on Bits-EntangledHugo -- 0.157.0en-usTue, 25 Aug 2026 12:00:00 +0000Three Days, Four Wrong Hypotheses, and One Uncensored 27B That Finally Serves on a Single RTX 5090https://stondo.github.io/posts/obliteratus-qwen38-27b-nvfp4-rtx5090/Tue, 25 Aug 2026 12:00:00 +0000https://stondo.github.io/posts/obliteratus-qwen38-27b-nvfp4-rtx5090/The full story of quantizing OBLITERATUS/Qwen3.8-27B-OBLITERATED to NVFP4 for a single RTX 5090 with vLLM and LMCache: every ModelOpt trap I fell into, the assertion that survived three fixes, and the one debugging trick that cracked it in a single run.