Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Anyone else getting gibberish when running unsloth/Qwen3.6-35B-A3B-GGUF:UD-IQ4_XS on CUDA (llama.cpp b8815)? UD-Q4_K_XL is fine, as is Vulkan in general.


Apparently it's a known issue with CUDA 13.2 [1].

[1] https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/discussi...


Yes sadly CUDA 13.2 is broken - NVIDIA will push a fix in CUDA 13.3




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: