Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

AetherArchitectural
/
GGUF-Quantization-Script

Text Generation
GGUF
quantized
text-generation-inference
Model card Files Files and versions Community
37
GGUF-Quantization-Script
Ctrl+K
Ctrl+K
  • 5 contributors
History: 25 commits
Lewdiculous's picture
Lewdiculous
Add checks for F16.gguf and imatrix.dat, as well make HF model removal optional by default.
7df3c68 verified about 1 year ago
  • imatrix
    Upload 2 files over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • README.md
    2.53 kB
    Add .cache notice. about 1 year ago
  • gguf-imat.py
    8.33 kB
    Add checks for F16.gguf and imatrix.dat, as well make HF model removal optional by default. about 1 year ago