Hacker News AIT2·Open Source
58 pts
Unsloth released Dynamic v3.1 quantizations for the Qwen3.8 family, including the 27B dense model and the 2.4T-A95B MoE variant, shipping GGUF weights across UD-Q4_K_XL down to IQ1_S bit-widths. The update pairs one-line installers with ready-made llama.cpp deployment commands, lowering the barrier to running very large MoE models locally.