AI & ML interests
Optimised quants for high-throughput deployments! Compatible with Transformers, TGI & vLLM 🤗
hugging-quants
's datasets
None public yet
Optimised quants for high-throughput deployments! Compatible with Transformers, TGI & vLLM 🤗