Vinitha2004
/

qwen2.5-coder-1.5B-instruct-awq-temp3-gguf-test

Model card Files Files and versions

qwen2.5-coder-1.5B-instruct-awq-temp3-gguf-test

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

Vinitha2004's picture

Upload folder using huggingface_hub

b2270c7 verified about 2 months ago

.gitattributes

1.73 kB

Upload folder using huggingface_hub about 2 months ago
fast_inference.py

6.51 kB

Upload folder using huggingface_hub about 2 months ago
model_f16.gguf

3.09 GB
xet

Upload folder using huggingface_hub about 2 months ago
model_q4_0.gguf

935 MB
xet

Upload folder using huggingface_hub about 2 months ago
model_q5_0.gguf

1.1 GB
xet

Upload folder using huggingface_hub about 2 months ago
model_q8_0.gguf

1.65 GB
xet

Upload folder using huggingface_hub about 2 months ago