longcodeu-leaderboard / results /Code Unit Semantic Analysis.csv
XuyuanGuo
Update results
52d52ce
raw
history blame contribute delete
661 Bytes
Model,Type,Model Size,Context Size,0~8K,8~16K,16~32K,32~64K,64~128K
CodeLlama,Code Model, 33.7B, 16K,60.35,68.57,_,_,_
Mistral-v0.3,General Model, 7.3B, 32K,66.00,65.24,52.21,_,_
Phi-3.5,General Model, 3.8B, 128K,55.75,58.22,44.30,34.38,32.07
DeepSeek-Coder-V2,Code Model, 15.7B, 128K,68.39,73.92,70.24,53.44,34.34
Qwen2.5-Coder,Code Model, 7.6B, 128K,71.76,74.95,69.12,69.61,64.98
DeepSeek-V2.5,General Model,236B, 128K,79.86,83.80,80.74,85.38,_
Gemini-1.5-Flash,General Model,_,1000K,76.15,85.17,83.02,83.46,84.54
Claude-3-5-Sonnet,General Model,_, 200K,81.19,38.34,36.61,21.44,22.12
GPT-4o,General Model,_, 128K,80.45,86.36,87.72,90.69,81.82