YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This repo is designed to store miscellaneous GGUF models referenced by some guides or wikis, rather than hotlink them directly to other repos and risk the links becoming broken in future.

They can be used with KoboldCpp. For more information, please read the KoboldCpp Wiki

Downloads last month
314
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support