Inference Providers
Active filters: 4-bit
unsloth/mistral-7b-bnb-4bit
Text Generation • 7B • Updated • 11.2k
• 29
xDAN-AI/xDAN-L1-Chat-RL-v1-awq
Text Generation • 7B • Updated YashRawal225/TheQuant-GPTQ
Text Generation • 7B • Updated • 3
TheBloke/Nous-Hermes-2-Yi-34B-AWQ
Text Generation • 34B • Updated • 20
• 7
TheBloke/Nous-Hermes-2-Yi-34B-GPTQ
Text Generation • 34B • Updated • 21
• 6
TheBloke/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-GPTQ
Text Generation • 47B • Updated • 29
• 2
TheBloke/Noromaid-v0.1-mixtral-8x7b-Instruct-v3-AWQ
Text Generation • 47B • Updated • 8
• 1
TheBloke/xDAN-L1-Chat-RL-v1-AWQ
Text Generation • 7B • Updated • 15
• 1
TheBloke/xDAN-L1-Chat-RL-v1-GPTQ
Text Generation • 7B • Updated • 39
• 3
TheBloke/Yi-34B-200K-AEZAKMI-v2-GPTQ
Text Generation • 34B • Updated • 57
• 2
TheBloke/Yi-34B-200K-AEZAKMI-v2-AWQ
Text Generation • 34B • Updated • 15
• 2
TheBloke/openthaigpt-1.0.0-beta-13B-chat-GPTQ
Text Generation • 13B • Updated • 10
• 3
TheBloke/openthaigpt-1.0.0-beta-13B-chat-AWQ
Text Generation • 13B • Updated • 9
• 1
TheBloke/neural-chat-7B-v3-3-wizardmath-dare-me-AWQ
Text Generation • 7B • Updated • 12
• 1
TheBloke/openchat-3.5-1210-starling-slerp-AWQ
Text Generation • 7B • Updated • 7
• 1
VictorNanka/phi-2-sft-lora
Text Generation • Updated • 14
TheBloke/neural-chat-7B-v3-3-wizardmath-dare-me-GPTQ
Text Generation • 7B • Updated • 17
• 1
TheBloke/openchat-3.5-1210-starling-slerp-GPTQ
Text Generation • 7B • Updated • 17
• 4
unsloth/codellama-34b-bnb-4bit
Text Generation • 35B • Updated • 212
• 3
7B • Updated • 2
CambioMoney/mixtral-instruct-MLFlowV4
Text Generation • 47B • Updated • 18
• 1
TheBloke/MixtralOrochi8x7B-AWQ
Text Generation • 47B • Updated • 11
• 2
TheBloke/MixtralOrochi8x7B-GPTQ
Text Generation • 47B • Updated • 23
• 7
ace2105/mistral-indian-rights
Text Generation • 7B • Updated • 5
unsloth/llama-2-13b-bnb-4bit
Text Generation • 13B • Updated • 682
• 7
TheBloke/Silicon-Maid-7B-AWQ
Text Generation • 7B • Updated • 7
• 9
TheBloke/Silicon-Maid-7B-GPTQ
Text Generation • 7B • Updated • 17
• 25
msamon/AdaptLLM-finance-chat-AWQ
Text Generation • 7B • Updated • 8
• 1
jakemannix/zephyr-7b-beta_assistant_v0.2_gptq
Text Generation • 7B • Updated • 14