How to use from
Docker Model Runner
docker model run hf.co/beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged
Quick Links

KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged

LoRA merged model from beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B

  • Developed by: beomi
  • License: apache-2.0
  • Finetuned from model : beomi/Solar-Ko-Recovery-11B

Eval with LogicKor

Default

Category Single turn Multi turn
์ดํ•ด(Understanding) 8.43 5.86
์ˆ˜ํ•™(Math) 3.86 1.00
๊ธ€์“ฐ๊ธฐ(Writing) 9.71 7.71
์ถ”๋ก (Reasoning) 7.57 3.86
์ฝ”๋”ฉ(Coding) 7.57 7.00
๋ฌธ๋ฒ•(Grammar) 7.43 4.14
Category Score
Single turn 7.43
Multi turn 4.93
Overall 6.18

1-Shot

Category Single turn Multi turn
์ถ”๋ก (Reasoning) 7.57 4.43
์ฝ”๋”ฉ(Coding) 7.29 8.57
์ˆ˜ํ•™(Math) 2.86 1.71
๊ธ€์“ฐ๊ธฐ(Writing) 9.29 7.57
์ดํ•ด(Understanding) 7.43 5.86
๋ฌธ๋ฒ•(Grammar) 7.29 4.71
Category Score
Single turn 6.95
Multi turn 5.48
Overall 6.21

CoT-1-Shot

Category Single turn Multi turn
์ฝ”๋”ฉ(Coding) 7.14 8.14
์ถ”๋ก (Reasoning) 6.86 3.57
๊ธ€์“ฐ๊ธฐ(Writing) 9.71 7.71
์ˆ˜ํ•™(Math) 2.29 1.14
์ดํ•ด(Understanding) 7.43 7.00
๋ฌธ๋ฒ•(Grammar) 7.29 3.14
Category Score
Single turn 6.79
Multi turn 5.12
Overall 5.95

Downloads last month
12
Safetensors
Model size
11B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged

Finetuned
(5)
this model
Quantizations
2 models