Qwen3.8-Flash-Next 177B MoE (ISTA GSQ-RCO IQ3_XXS) self-hosted on RTX 5090 Laptop (24GB VRAM + 64GB RAM) via Strata: up to 110 tok/s (100+ sustained), 256K full context, vision, MTP speculative decoding, reasoning default xhigh (max tier). GPU+CPU both saturated. 26 measured rounds, 7 quant tiers screened. 中英双语实测实录
self-hosted moe strata quantization mtp reasoning vision-language-model local-llm gguf speculative-decoding rtx5090 qwen3 qwen38 256k-context flash-next iq3-xxs
-
Updated
Oct 5, 2026 - Python