Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

404

Base only

Active filters: quark

amd/Qwen3.8-27B-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated Aug 26 • 34.7k • 39

amd/Muse-Spark-Open-816B-A42B-Quark-MXFP4

435B • Updated 12 days ago • 2.36k • 2

amd/Qwen3.8-Flash-Next-Quark-MXFP4-AttnFP8-PLEFP8

Image-Text-to-Text • 118B • Updated 13 days ago • 209 • 2

amd/MiniMax-M3.1-Flash-Quark-MXFP4

220B • Updated 1 day ago • 586 • 1

fxmarty/llama-tiny-testing-quark-indev

1.03M • Updated Oct 3, 2024 • 8

fxmarty/llama-tiny-int4-per-group-sym

1.03M • Updated Oct 25, 2024 • 4

fxmarty/llama-tiny-w-fp8-a-fp8

1.03M • Updated Oct 22, 2024 • 10

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Oct 22, 2024 • 9

fxmarty/llama-tiny-w-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 19

fxmarty/llama-small-int4-per-group-sym-awq

16.7M • Updated Oct 29, 2024 • 7

fxmarty/quark-legacy-int8

1.03M • Updated Oct 10, 2024 • 9

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 11

fxmarty/llama-small-int4-per-group-sym-awq-old

16.7M • Updated Oct 25, 2024 • 6

amd-quark/llama-tiny-w-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 23

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 17

amd-quark/llama-tiny-w-fp8-a-fp8

1.03M • Updated Dec 18, 2024 • 22

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Dec 18, 2024 • 24

amd-quark/llama-tiny-int4-per-group-sym

1.03M • Updated Dec 18, 2024 • 20

amd-quark/llama-small-int4-per-group-sym-awq

16.7M • Updated Dec 18, 2024 • 22

amd-quark/quark-legacy-int8

1.03M • Updated Dec 18, 2024 • 13

amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test

8B • Updated Jun 18 • 475

amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test

8B • Updated Jun 18 • 247

EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym

Text Generation • 8B • Updated Jan 22, 2025 • 22

amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead

Text Generation • 2B • Updated Jan 30, 2025 • 31

amd-quark/llama-tiny-fp8-quark-quant-method

17.1M • Updated Feb 7, 2025 • 180

aigdat/Qwen2.5-Coder-7B-quantized-ppl-14

1B • Updated Mar 11, 2025 • 11

aigdat/Qwen2-7B-Instruct_quantized_int4_bfloat16

1B • Updated Mar 13, 2025 • 3

aigdat/Qwen2.5-1.5B-Instruct-awq-uint4-bfloat16

0.4B • Updated Mar 13, 2025 • 10

aigdat/Qwen2.5-0.5B-Instruct-awq-int4-asym-g128-fp16

0.2B • Updated Apr 2, 2025 • 5

superbigtree/Mistral-Nemo-Instruct-2407-FP8

12B • Updated Apr 9, 2025 • 13