Inference Providers
Active filters: dpo
syntropy-ai/Soren-1-Small
Text Generation
• 2B • Updated • 1.04k
• 18
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4
Image-Text-to-Text
• 74B • Updated • 864
• 3
F16/z-image-turbo-flow-dpo
Feature Extraction
• Updated • 184
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated
Image-Text-to-Text
• 123B • Updated • 766
• 7
Text Generation
• 7B • Updated • 64
• • 124
Text Generation
• 47B • Updated • 60
• 165
ContextualAI/Contextual_KTO_Mistral_PairRM
Text Generation
• 7B • Updated • 81
• • 33
QuantFactory/NeuralDaredevil-8B-abliterated-GGUF
Text Generation
• 8B • Updated • 5.69k
• 94
mradermacher/ToxicHermes-2.5-Mistral-7B-GGUF
7B • Updated • 85
• 1
mradermacher/RedSage-Qwen3-8B-DPO-GGUF
Text Generation
• 8B • Updated • 373
• 4
trentmkelly/gpt-4o-distil-Llama-3.3-70B-Instruct
Text Generation
• Updated • 8
• 3
mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF
8B • Updated • 575
• 7
YiyingXie/gemma-3-270m-it-dpo
danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF
Text Generation
• 9B • Updated • 1.26k
• 17
BugTraceAI/BugTraceAI-Apex-G4-26B-Master-f16
25B • Updated • 77
• 5
XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2
Text Generation
• Updated • 115
• 1
mradermacher/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-i1-GGUF
125B • Updated • 6.05k
• 3
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-MTPLX-4bit
Image-Text-to-Text
• 20B • Updated • 1.2k
• 1
MRockatansky/Gemma-4-31B-storymaxxed2-GGUF
Text Generation
• 31B • Updated • 2.88k
• 1
yakz1/gemma-4-e4b-question-algerienne-dpo-analyse-qualitative-608-2ep-GGUF
Image-Text-to-Text
• 7B • Updated • 39
• 1
F16/z-image-turbo-masked-dpo
Text-to-Image
• Updated • • 24
lyogavin/Anima33B-DPO-Belle-1k
Text Generation
• Updated • 1
lyogavin/Anima33B-DPO-Belle-1k-merged
Text Generation
• Updated • 15
• 12
daekeun-ml/Llama-2-ko-DPO-13B
Text Generation
• 13B • Updated • 26
• 19
lewtun/zephyr-7b-dpo-full
Text Generation
• 7B • Updated • 5
alignment-handbook/zephyr-7b-dpo-full
Text Generation
• 7B • Updated • 20
• 3
alignment-handbook/zephyr-7b-dpo-qlora
Updated • 11
• 9
Text Generation
• Updated • 25
• 7
argilla/notus-7b-v1-lora-adapter
Text Generation
• Updated • 3
ContextualAI/archangel_sft_pythia1-4b
Text Generation
• 1B • Updated • 5