longcodeu-leaderboard / results /Dependency Relation Analysis 2.csv
XuyuanGuo
Update results
52d52ce
raw
history blame contribute delete
661 Bytes
Model,Type,Model Size,Context Size,0~8K,8~16K,16~32K,32~64K,64~128K
CodeLlama,Code Model, 33.7B, 16K,40.66,28.49,_,_,_
Mistral-v0.3,General Model, 7.3B, 32K,14.85,16.90,24.09,_,_
Phi-3.5,General Model, 3.8B, 128K,16.39,23.65,13.46, 3.57, 4.73
DeepSeek-Coder-V2,Code Model, 15.7B, 128K,20.45,30.74,27.59,28.12,17.26
Qwen2.5-Coder,Code Model, 7.6B, 128K, 4.16, 7.30, 7.22, 7.00,18.31
DeepSeek-V2.5,General Model,236B, 128K,57.65,60.40,62.87,57.61,_
Gemini-1.5-Flash,General Model,_,1000K,42.23,48.82,51.61,39.90,49.98
Claude-3-5-Sonnet,General Model,_, 200K,60.01,46.77,36.18,19.51,12.98
GPT-4o,General Model,_, 128K,44.39,52.08,48.29,45.48,52.35