Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a model
5 days ago
huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated
liked
a model
7 days ago
openai/gpt-oss-20b
liked
a model
7 days ago
openai/gpt-oss-120b
Organizations
models
221
nbeerbower/Eloisa-Qwen3-8B
8B
•
Updated
•
22
•
4
nbeerbower/Wenyan-Qwen3-8B
8B
•
Updated
•
6
•
1
nbeerbower/NikuXL-v0.1
Text-to-Image
•
Updated
•
4
nbeerbower/NikuX1-Test
Text-to-Image
•
Updated
•
3
nbeerbower/Yanfei-v2-Qwen3-32B
Text Generation
•
33B
•
Updated
•
13
•
2
nbeerbower/Menghua-Qwen3-32B-lora
Updated
•
3
nbeerbower/Zhiming-Qwen3-32B-lora
Updated
•
2
nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B
12B
•
Updated
•
9
•
4
nbeerbower/Vitus-Qwen3-14B
15B
•
Updated
•
23
•
4
nbeerbower/Vitus-mistral-nemo-12B
12B
•
Updated
•
8
datasets
21
nbeerbower/WenyanMix-DPO
Viewer
•
Updated
•
30.2k
•
89
nbeerbower/NikuX-DPO-captioned
Viewer
•
Updated
•
792
•
14
nbeerbower/NikuX-DPO-filtered
Viewer
•
Updated
•
792
•
12
nbeerbower/NikuX-DPO-concat
Viewer
•
Updated
•
883
•
11
nbeerbower/NikuX3-DPO-Filtered
Viewer
•
Updated
•
581
•
11
nbeerbower/NikuX3-DPO
Viewer
•
Updated
•
651
•
5
nbeerbower/NikuX2-DPO-Filtered
Viewer
•
Updated
•
282
•
9
nbeerbower/YanfeiMix-DPO
Viewer
•
Updated
•
22.4k
•
46
•
1
nbeerbower/human-writing-dpo
Updated
•
51
•
7
nbeerbower/NikuX2-DPO
Viewer
•
Updated
•
333
•
6