Models

gurro/llama-3.1-8B-torchao-int4wo-128

Text Generation • Updated Dec 2, 2024

gurro/llama-3.1-8B-torchao-int4wo-256

Text Generation • Updated Dec 2, 2024

jerryzh168/llama3-8b-autoquant

Text Generation • Updated Feb 19 • 1

medmekk/Llama-3.1-8B-Instruct-torchao-int8_weight_only

Updated Jan 8 • 1

medmekk/Llama-3.1-8B-Instruct-torchao-int8wo

Updated Jan 8

medmekk/Llama-3.1-8B-Instruct-torchao-int8da8w

Updated Jan 8

medmekk/Llama-3.2-3B-Instruct-torchao-int8wo

Updated Jan 8 • 1

medmekk/Llama-3.2-1B-torchao-int8wo

Updated Jan 8

medmekk/Llama-3.2-1B-torchao-int8da8w

Updated Jan 8 • 2

medmekk/Llama-3.2-3B-Instruct-torchao-int8da8w

Updated Jan 8

medmekk/Llama-3.1-70B-Instruct-torchao-int8da8w

Updated Jan 8

jerryzh168/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Jan 13 • 1

jerryzh168/Meta-Llama-3-8B-torchao-int4_weight_only-gs_128

Updated Jan 13 • 1

jerryzh168/Meta-Llama-3-8B-torchao-int4_weight_only-gs_64

Updated Jan 13

HF-Quantization/Llama-3.2-1B-TORCHAO-W8

Updated Jan 21

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

Updated Jan 21

HF-Quantization/Llama-3.2-1B-TORCHAO-W4

Updated Jan 21

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

Updated Jan 22

jpablomch/Meta-Llama-3-8B-Instruct-torchao

Text Generation • Updated Feb 19

jerryzh168/llama3-8b-int4wo-128

Text Generation • Updated Feb 21

jerryzh168/llama3-8b-int8wo

Text Generation • Updated Feb 27

alpindale/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Mar 2 • 31

drisspg/f8a8-opt-125m

Text Generation • Updated Mar 4 • 5

drisspg/f8a8-opt-125m_2

Text Generation • Updated Mar 5 • 3

drisspg/float8_dynamic_act_float8_weight-opt-125m

Text Generation • Updated Mar 19 • 5

marksaroufim/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Mar 20 • 1

jerryzh168/llama3-int8wo

Text Generation • Updated Mar 20

jerryzh168/llama3-int4wo

Text Generation • Updated Mar 21

jerryzh168/gemma3-8da4w

Image-Text-to-Text • Updated Mar 25

jerryzh168/gemma3-4b-it-float8dq

Image-Text-to-Text • Updated Mar 26