hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF
Text Generation
•
3B
•
Updated
•
2.12k
•
50
Llama 3.2 3B & 1B GGUF Quants
Llama.cpp compatible quants for Llama 3.2 3B and 1B Instruct models.
-
-
hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 5.37k • 20 -
hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF
Text Generation • 1B • Updated • 22.8k • 34 -
hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 51.9k • 16