File size: 347 Bytes
1a6c70c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
FR-Ponder Evaluation Results
==============================

Dataset: gsm8k
--------------------
FR-Ponder:
  Accuracy: 0.000
  Avg FLOPs: 1548841728
  Avg Time: 3.288s
  Avg Steps: 118.1
Baseline (α=0.4):
  Accuracy: 0.240
  Avg FLOPs: 1264988628340
  Avg Time: 5.507s
Improvements:
  Accuracy: +-0.240
  FLOPs reduction: 99.9%
  Speedup: 1.68x