dat-lequoc
/

vLLM-fast-apply-4bit-v0.1

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

vLLM-fast-apply-4bit-v0.1

Commit History

Upload README.md with huggingface_hub

bd0e3bb
verified

LE Quoc Dat commited on Sep 25, 2024

initial commit

229c464
verified

LE Quoc Dat commited on Sep 25, 2024