HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
2
meta-llama/Llama-3.2-1B Quantized
Find the quantized versions of Llama-3.2-1B all in one place
-
-
HF-Quantization/Llama-3.2-1B-BNB-INT8
1B • Updated • 2 -
HF-Quantization/Llama-3.2-1B-BNB-NF4
0.8B • Updated • 2 -
HF-Quantization/Llama-3.2-1B-BNB-FP4
0.8B • Updated • 6 -
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
0.8B • Updated • 2 -
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
0.8B • Updated • 3 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated • 2 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated • 2 -
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
0.4B • Updated • 5