Inference Providers
Active filters: AWQ
QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ
Text Generation • 31B • Updated • 91.5k
• 46
abhinavkulkarni/mosaicml-mpt-7b-instruct-w4-g128-awq
Text Generation • Updated • 28
abhinavkulkarni/mosaicml-mpt-7b-chat-w4-g128-awq
Text Generation • 1B • Updated • 40
abhinavkulkarni/VMware-open-llama-7b-open-instruct-w4-g128-awq
Text Generation • Updated • 16
abhinavkulkarni/VMware-open-llama-13b-open-instruct-w4-g128-awq
Text Generation • Updated • 20
• 3
abhinavkulkarni/tiiuae-falcon-7b-instruct-w4-g64-awq
Text Generation • Updated • 75
• 5
abhinavkulkarni/psmathur-orca_mini_v2_7b-w4-g128-awq
Text Generation • Updated • 9
• 2
abhinavkulkarni/Salesforce-codegen25-7b-multi-w4-g128-awq
Text Generation • Updated • 152
• 2
abhinavkulkarni/psmathur-orca_mini_v2_13b-w4-g128-awq
Text Generation • Updated • 90
• 2
abhinavkulkarni/mosaicml-mpt-30b-instruct-w4-g128-awq
Text Generation • Updated • 31
• 2
abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq
Text Generation • 4B • Updated • 43
abhinavkulkarni/VMware-open-llama-7b-v2-open-instruct-w4-g128-awq
Text Generation • Updated • 19
abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq
Text Generation • Updated • 20
• 2
abhinavkulkarni/Salesforce-codegen25-7b-instruct-w4-g128-awq
Text Generation • Updated • 124
• 3
abhinavkulkarni/meta-llama-Llama-2-7b-chat-hf-w4-g128-awq
Text Generation • Updated • 24
• 6
abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq
Text Generation • Updated • 16
• 1
abhinavkulkarni/stabilityai-StableBeluga-7B-w4-g128-awq
Text Generation • Updated • 7
• 1
abhinavkulkarni/stabilityai-StableBeluga-13B-w4-g128-awq
Text Generation • Updated • 16
• 1
abhinavkulkarni/codellama-CodeLlama-7b-Instruct-hf-w4-g128-awq
Text Generation • Updated • 37
abhinavkulkarni/codellama-CodeLlama-7b-Python-hf-w4-g128-awq
Text Generation • Updated • 154
abhinavkulkarni/codellama-CodeLlama-13b-Instruct-hf-w4-g128-awq
Text Generation • 2B • Updated • 46
abhinavkulkarni/codellama-CodeLlama-13b-Python-hf-w4-g128-awq
Text Generation • Updated • 152
xDAN-AI/xDAN-L1-Chat-RL-v1-awq
Text Generation • 7B • Updated solidrust/Noromaid-7B-0.4-DPO-AWQ
Text Generation • 7B • Updated • 17
• 1
solidrust/WestLake-7B-v2-AWQ
Text Generation • 7B • Updated • 15
• 4
solidrust/WestLake-7B-v2-laser-AWQ
Text Generation • 7B • Updated • 10
• 1
MaziyarPanahi/Mistral-7B-Instruct-v0.2-AWQ
Text Generation • 7B • Updated • 13
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-AWQ
Text Generation • 7B • Updated • 9
• 1
MaziyarPanahi/Smaug-72B-v0.1-AWQ
Text Generation • 72B • Updated • 9
• 3
MaziyarPanahi/WizardLM-70B-V1.0-AWQ
Text Generation • 69B • Updated • 10
• 1