unsloth
/

gemma-2-27b-it-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Aphrodite/VLLM/SGLang all refuse to load this model

#5 opened 11 months ago by

Dealing with the split safetensor files

#4 opened 12 months ago by

How to create gguf fromm this

#3 opened about 1 year ago by

hidden state is nan

#2 opened about 1 year ago by

whats the best tool to run this model

#1 opened about 1 year ago by