GGUF
community
AI & ML interests
Our goal is to simplify the process of searching for and exchanging quantized models in GGUF format, as well as to create a space for efficient exchange and access to the models you need
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 9 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 103 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 23 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 55 • 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 10 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 9 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation • 2B • Updated • 9 • 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation • 8B • Updated • 6 • 1
-
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation • 9B • Updated • 39 -
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation • 9B • Updated • 19 -
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation • 9B • Updated • 26 • 1 -
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation • 9B • Updated • 20
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 5 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 13 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 12 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 37
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 46 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 14 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 60 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 13
-
matrixportalx/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 25 -
Triangle104/Rombos-Coder-V2.5-Qwen-14b-Q4_K_M-GGUF
Text Generation • 15B • Updated • 67 -
Triangle104/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation • 33B • Updated • 121 -
Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 65
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 31 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated • 23 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 18 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated • 34
-
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation • 8B • Updated • 19 -
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 20 • 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B • Updated • 17 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B • Updated • 19
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 9 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 103 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 23 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 55 • 1
-
matrixportalx/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 25 -
Triangle104/Rombos-Coder-V2.5-Qwen-14b-Q4_K_M-GGUF
Text Generation • 15B • Updated • 67 -
Triangle104/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation • 33B • Updated • 121 -
Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 65
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 10 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 9 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation • 2B • Updated • 9 • 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation • 8B • Updated • 6 • 1
-
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation • 9B • Updated • 39 -
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation • 9B • Updated • 19 -
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation • 9B • Updated • 26 • 1 -
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation • 9B • Updated • 20
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 31 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated • 23 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 18 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated • 34
-
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation • 8B • Updated • 19 -
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 20 • 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B • Updated • 17 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B • Updated • 19
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 5 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 13 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 12 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 37
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 46 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 14 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 60 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 13