HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8
Updated
HF Quantization
community
AI & ML interests
Making AI models smaller, and faster with Quantization
HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4
Updated
•
25
HF-Quantization/Llama-3.2-1B-BNB-INT8
1B
•
Updated
•
7
HF-Quantization/Llama-3.2-1B-BNB-NF4
0.8B
•
Updated
•
30
HF-Quantization/Llama-3.2-1B-BNB-FP4
0.8B
•
Updated
•
37
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
0.8B
•
Updated
•
34
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
0.8B
•
Updated
•
17
HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
71
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated
•
10
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated
•
13
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
0.4B
•
Updated
•
8