No NVFP4 build of the uncensored Qwen3.8-27B existed, so I made one. It took a fake-quantization scare, a rename odyssey across 800 tensors, an MTP file that quietly loaded the vision tower twice, and one instrumented container run that proved everything I believed was wrong. 40 tok/s single stream, 317 tok/s with 8 concurrent subagents.
Instead of picking one model per task, I made three machines cooperate: a big thinking model for primary reasoning, a fast local 27B for subagent loops and images, a router with automatic failover in front of everything, and shared agent memory. Total cost: electricity. Here is the full architecture, the benchmarks, and the lessons learned the hard way.
I chased a modprobe error across two DGX Spark nodes, peeled back layers of Secure Boot signing and kernel build flags, read the nvidia_peermem source code, and discovered that GPUDirect RDMA is architecturally unsupported on the GB10 Grace Blackwell SoC. Here’s the full story.