Models

lmstudio-community/Devstral-Small-2507-MLX-4bit

Text Generation • 24B • Updated Jul 10 • 342k • 2

unsloth/Magistral-Small-2507-GGUF

24B • Updated 16 days ago • 13.8k • 12

unsloth/Magistral-Small-2507

24B • Updated 17 days ago • 121 • 2

unsloth/Magistral-Small-2507-unsloth-bnb-4bit

24B • Updated 17 days ago • 577 • 2

unsloth/Magistral-Small-2507-bnb-4bit

24B • Updated 17 days ago • 16 • 1

2imi9/Qwen3-1.7B-NVFP4A16

Text Generation • 1B • Updated 5 days ago • 19 • 1

nightmedia/gpt-oss-20b-q5-hi-mlx

Text Generation • 21B • Updated 5 days ago • 492 • 1

NexVeridian/gpt-oss-120b-5bit

Text Generation • 117B • Updated 5 days ago • 364 • 1

prayanksai/gpt-oss-120b-MLX-6bit

Text Generation • 117B • Updated 5 days ago • 1.02k • 1

huynguyendbs/gpt-oss-20b-mlx

Text Generation • 21B • Updated 5 days ago • 675 • 1

mlx-community/gpt-oss-120b-4bit

Text Generation • 117B • Updated 5 days ago • 251 • 1

lokinfey/gpt-oss-20B-mlx-metal-int4

Text Generation • 21B • Updated 1 day ago • 86 • 1

Inferless/deciLM-7B-GPTQ

Text Generation • Updated Jan 4, 2024 • 4 • 1

Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Jan 4, 2024 • 5 • 2

Inferless/Mixtral-8x7B-v0.1-int8-GPTQ

Text Generation • Updated Jan 25, 2024 • 4 • 2

RedHatAI/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated Jul 18, 2024 • 4.75k • • 23

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • 47B • Updated Jul 18, 2024 • 61 • 3

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • 8B • Updated Jun 19, 2024 • 5.43k • • 8

RedHatAI/Meta-Llama-3-70B-Instruct-FP8

Text Generation • 71B • Updated Jul 18, 2024 • 1.84k • • 13

mistralai/Codestral-22B-v0.1

22B • Updated 17 days ago • 24k • 1.29k

RedHatAI/Qwen2-72B-Instruct-FP8

Text Generation • 73B • Updated Jul 18, 2024 • 1.42k • 15

mradermacher/Mistral-7B-Instruct-v0.3-GGUF

7B • Updated 16 days ago • 672 • 2

mradermacher/Mistral-7B-Instruct-v0.3-i1-GGUF

7B • Updated 16 days ago • 264 • 1

RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8

Text Generation • 141B • Updated Aug 12, 2024 • 8 • 3

RedHatAI/Qwen2-0.5B-Instruct-FP8

Text Generation • 0.5B • Updated Jul 18, 2024 • 1.36k • 3

RedHatAI/Qwen2-1.5B-Instruct-FP8

Text Generation • 2B • Updated Jul 18, 2024 • 5.64k

RedHatAI/Qwen2-7B-Instruct-FP8

Text Generation • 8B • Updated Jul 18, 2024 • 15.5k • • 2

nm-testing/SparseLlama-3-8B-pruned_50.2of4-FP8

Text Generation • 8B • Updated Jun 25, 2024 • 2

FlorianJc/Hermes-2-Pro-Mistral-7B-vllm-fp8

Text Generation • 7B • Updated Jul 17, 2024 • 3

FlorianJc/openchat-3.6-8b-20240522-vllm-fp8

Text Generation • 8B • Updated Jul 17, 2024 • 4