QuantFactory Banner

QuantFactory/SOLAR-10.7B-Instruct-v1.0-uncensored-GGUF

This is quantized version of w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored created using llama.cpp

Original Model Card

SOLAR-10.7B-Instruct-v1.0-uncensored

SOLAR-10.7B-Instruct-v1.0 finetuned to be less censored. Refer to upstage/SOLAR-10.7B-Instruct-v1.0 for model info and usage instructions.

Training details

This model was trained using Lora and DPOTrainer on unalignment/toxic-dpo-v0.1

How to Cite

@misc{solarUncensoredDPO,
      title={solar-10.7b-instruct-V1.0-uncensored},
      url={https://huggingface.co/w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored},
      author={Stepan Zuev},
      year={2023},
      month={Dec}
} 

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 20.56
IFEval (0-Shot) 38.84
BBH (3-Shot) 33.86
MATH Lvl 5 (4-Shot) 0.23
GPQA (0-shot) 5.93
MuSR (0-shot) 18.49
MMLU-PRO (5-shot) 26.04
Downloads last month
44
GGUF
Model size
10.7B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Evaluation results