GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 13
# No code snippets available yet for this library.
# To use this model, check the repository files and the library's documentation.
# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js4-bit GPTQ quantized version of Qwen2.5-Coder-7B-Instruct for use with the Private LLM app.
- Downloads last month
- -