A collection of Llama 3 models quantized by Astronomer
-
astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit
Text Generation • 3B • Updated • 829 • 25 -
astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit
Text Generation • 2B • Updated • 1.09k • 25 -
astronomer/Llama-3-8B-GPTQ-8-Bit
Text Generation • 3B • Updated • 40 • 2 -
astronomer/Llama-3-8B-GPTQ-4-Bit
Text Generation • 2B • Updated • 875 • 6