FOU//CAL

~/category/it

IT & Systems — Servers, networks, homelab, virtualization, automation.

IT & SystemsNov 9, 20266 min

One quant, two machines: Unsloth Dynamic v3.1 across five GPU generations

The same Qwen3.8-Flash-Next quant landed on my Strix Halo and my 1080 Ti on the same day. Same weights, same release notes — completely different optimization problems. Here is the sizing math, the receipts, and the three ops traps I fell into while upgrading both.

#unsloth#quantization#strix-halo#1080-ti#gufo#strata#qwen
IT & SystemsNov 7, 20267 min

The third death notice was a compiler: tuning an inference engine on a 2017 GPU

CUDA 13 stopped compiling for Pascal — the third formal death notice for my 1080 Ti fallback. Before accepting it I ran a proper A/B campaign on the engine: one free 20 % decode win, one flag I kept on bitwise-parity evidence, three I rejected as noise, and two measurements I distrust even now.

#gpu#nvidia#pascal#cuda#local-llm#benchmarking#strata