Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
AI & ML interests
Decentralized GenAI Agents network on the Edge
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
-
gaianet/Llama-3.2-1B-Instruct-GGUF
Text Generation β’ 1B β’ Updated β’ 126 -
gaianet/Llama-3.2-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 79 β’ 1 -
gaianet/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation β’ 8B β’ Updated β’ 424 -
gaianet/Llama-3.3-70B-Instruct-GGUF
Text Generation β’ 71B β’ Updated β’ 215
-
gaianet/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation β’ 24B β’ Updated β’ 162 -
gaianet/Mistral-7B-Instruct-v0.3-GGUF
Text Generation β’ 7B β’ Updated β’ 89 β’ 1 -
gaianet/Mistral-Nemo-Instruct-2407-GGUF
Text Generation β’ 12B β’ Updated β’ 88 β’ 1 -
gaianet/Mistral-Large-Instruct-2407-GGUF
123B β’ Updated β’ 146
-
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF
Text Generation β’ 71B β’ Updated β’ 176 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation β’ 33B β’ Updated β’ 105 -
gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation β’ 8B β’ Updated β’ 160 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation β’ 8B β’ Updated β’ 201
Gaia compatible quants for InternLM-2.5 models.
-
gaianet/gemma-3-27b-it-GGUF
Image-Text-to-Text β’ 27B β’ Updated β’ 213 β’ 1 -
gaianet/gemma-3-12b-it-GGUF
Image-Text-to-Text β’ 12B β’ Updated β’ 232 β’ 1 -
gaianet/gemma-3-4b-it-GGUF
Image-Text-to-Text β’ 4B β’ Updated β’ 183 β’ 1 -
gaianet/gemma-3-1b-it-GGUF
Text Generation β’ 1.0B β’ Updated β’ 234 β’ 2
Gaia compatible quants for Qwen 2.5 instruct and coder models.
-
gaianet/Qwen2.5-72B-Instruct-GGUF
Text Generation β’ 73B β’ Updated β’ 135 β’ 1 -
gaianet/Qwen2.5-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 280 -
gaianet/Qwen2.5-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 688 β’ 1 -
gaianet/Qwen2.5-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 283
Gaia compatible quants for Qwen2.5-Coder models.
-
gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 277 -
gaianet/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 294 -
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 212 β’ 2 -
gaianet/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation β’ 0.5B β’ Updated β’ 104
Gaia compatible quants for functionary models
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
-
gaianet/gemma-3-27b-it-GGUF
Image-Text-to-Text β’ 27B β’ Updated β’ 213 β’ 1 -
gaianet/gemma-3-12b-it-GGUF
Image-Text-to-Text β’ 12B β’ Updated β’ 232 β’ 1 -
gaianet/gemma-3-4b-it-GGUF
Image-Text-to-Text β’ 4B β’ Updated β’ 183 β’ 1 -
gaianet/gemma-3-1b-it-GGUF
Text Generation β’ 1.0B β’ Updated β’ 234 β’ 2
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
-
gaianet/Llama-3.2-1B-Instruct-GGUF
Text Generation β’ 1B β’ Updated β’ 126 -
gaianet/Llama-3.2-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 79 β’ 1 -
gaianet/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation β’ 8B β’ Updated β’ 424 -
gaianet/Llama-3.3-70B-Instruct-GGUF
Text Generation β’ 71B β’ Updated β’ 215
Gaia compatible quants for Qwen 2.5 instruct and coder models.
-
gaianet/Qwen2.5-72B-Instruct-GGUF
Text Generation β’ 73B β’ Updated β’ 135 β’ 1 -
gaianet/Qwen2.5-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 280 -
gaianet/Qwen2.5-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 688 β’ 1 -
gaianet/Qwen2.5-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 283
-
gaianet/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation β’ 24B β’ Updated β’ 162 -
gaianet/Mistral-7B-Instruct-v0.3-GGUF
Text Generation β’ 7B β’ Updated β’ 89 β’ 1 -
gaianet/Mistral-Nemo-Instruct-2407-GGUF
Text Generation β’ 12B β’ Updated β’ 88 β’ 1 -
gaianet/Mistral-Large-Instruct-2407-GGUF
123B β’ Updated β’ 146
Gaia compatible quants for Qwen2.5-Coder models.
-
gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 277 -
gaianet/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 294 -
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 212 β’ 2 -
gaianet/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation β’ 0.5B β’ Updated β’ 104
-
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF
Text Generation β’ 71B β’ Updated β’ 176 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation β’ 33B β’ Updated β’ 105 -
gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation β’ 8B β’ Updated β’ 160 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation β’ 8B β’ Updated β’ 201
Gaia compatible quants for functionary models
Gaia compatible quants for InternLM-2.5 models.