Spaces:
Running
Running
Model,Type,Model Size,Context Size,0~8K,8~16K,16~32K,32~64K,64~128K | |
CodeLlama,Code Model, 33.7B, 16K,43.01,26.00,_,_,_ | |
Mistral-v0.3,General Model, 7.3B, 32K,48.69,34.03,16.87,_,_ | |
Phi-3.5,General Model, 3.8B, 128K,33.72,25.69,15.81, 8.76, 2.56 | |
DeepSeek-Coder-V2,Code Model, 15.7B, 128K,53.01,45.55,25.79,21.99, 6.80 | |
Qwen2.5-Coder,Code Model, 7.6B, 128K,50.89,39.33,17.64,12.86, 8.45 | |
DeepSeek-V2.5,General Model,236B, 128K,70.90,60.46,38.09,37.18,_ | |
Gemini-1.5-Flash,General Model,_,1000K,70.40,58.13,28.83,31.11,26.37 | |
Claude-3-5-Sonnet,General Model,_, 200K,70.04,53.96,18.36,15.28,10.35 | |
GPT-4o,General Model,_, 128K,73.34,58.78,37.04,36.68,29.62 |