Qwen3.6 27B FP8

FP8 safetensors archive

Download
Format
tar
Size
28.77 GiB
https://huggingface.co/Qwen/Qwen3.6-27B-FP8 9a23fab5be32a4f6e804bed568cf50b40fd90949fbbf39259014668983cd0707

Qwen3.6 35B A3B FP8

FP8 safetensors archive

Download
Format
tar
Size
34.92 GiB
https://huggingface.co/Qwen/Qwen3.6-35B-A3B-FP8 aa1cfa134f8ddc68b9e011972fbd83ff02377cecbcd8f71fbd41f615eb4d7db9

Qwen3.6 35B A3B IQ4_XS

4-bit GGUF

Download
Format
GGUF
Size
16.51 GiB
https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/blob/main/Qwen3.6-35B-A3B-UD-IQ4_XS.gguf 649d7508507b84638732c4f52c24c8b15843c6dca2f3ff793ae07c14a67ebbb3

Qwen3.6 35B A3B Q8_K_XL

8-bit GGUF

Download
Format
GGUF
Size
35.81 GiB
https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/blob/main/Qwen3.6-35B-A3B-UD-Q8_K_XL.gguf b762215c5f507f4865df4ac3d1afa803828afa41e05ecac3fac431a67bbd88e8

Gemma 4 31B IT NVFP4

RedHatAI NVFP4 safetensors archive

Download
Format
tar
Size
21.70 GiB
https://huggingface.co/RedHatAI/gemma-4-31B-it-NVFP4 3e9da35d9f9151b4b6958cedf2fbe1be97452f3643895f0f220d2a6a7fc956df