- Developed by: cstr
- License: apache-2.0
- Finetuned from model : vonjack/Phi-3-mini-4k-instruct-LLaMAfied
This is a quick experiment with only 150 orpo steps from a german dataset.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 4
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for cstr/phi-3-orpo-v8_16
Base model
vonjack/Phi-3-mini-4k-instruct-LLaMAfied