ngocnamk3er commited on
Commit
30a8754
·
verified ·
1 Parent(s): 28d8bde

End of training

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -41,8 +41,8 @@ The following hyperparameters were used during training:
41
  - total_train_batch_size: 256
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
- - lr_scheduler_warmup_steps: 10000
45
- - training_steps: 30000
46
 
47
  ### Training results
48
 
 
41
  - total_train_batch_size: 256
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
+ - lr_scheduler_warmup_steps: 3000
45
+ - training_steps: 60000
46
 
47
  ### Training results
48