Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
trl-lib
/
Qwen2-0.5B-ORPO
like
2
Follow
TRL
141
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
orpo
conversational
text-generation-inference
arxiv:
2403.07691
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
main
Qwen2-0.5B-ORPO
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
qgallouedec
HF Staff
End of training
5807863
verified
10 months ago
.gitattributes
Safe
1.57 kB
End of training
10 months ago
README.md
Safe
2.23 kB
End of training
10 months ago
added_tokens.json
Safe
80 Bytes
End of training
10 months ago
config.json
Safe
733 Bytes
End of training
10 months ago
generation_config.json
Safe
247 Bytes
End of training
10 months ago
merges.txt
Safe
1.67 MB
End of training
10 months ago
model.safetensors
Safe
1.98 GB
xet
End of training
10 months ago
special_tokens_map.json
Safe
367 Bytes
End of training
10 months ago
tokenizer.json
Safe
11.4 MB
xet
End of training
10 months ago
tokenizer_config.json
Safe
1.3 kB
End of training
10 months ago
training_args.bin
Safe
5.56 kB
xet
End of training
10 months ago
vocab.json
Safe
2.78 MB
End of training
10 months ago
