oracat commited on
Commit
0996383
·
1 Parent(s): db546cb

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.8059
20
- - Accuracy: 0.586
21
 
22
  ## Model description
23
 
@@ -37,8 +37,8 @@ More information needed
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 5e-05
40
- - train_batch_size: 64
41
- - eval_batch_size: 8
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
@@ -48,9 +48,9 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
- | 1.8012 | 1.0 | 16 | 1.8824 | 0.584 |
52
- | 1.4111 | 2.0 | 32 | 1.8159 | 0.568 |
53
- | 1.3755 | 3.0 | 48 | 1.8059 | 0.586 |
54
 
55
 
56
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.1661
20
+ - Accuracy: 0.6440
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 5e-05
40
+ - train_batch_size: 256
41
+ - eval_batch_size: 32
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
50
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
51
+ | 1.3877 | 1.0 | 247 | 1.2393 | 0.6278 |
52
+ | 1.1172 | 2.0 | 494 | 1.1769 | 0.6415 |
53
+ | 0.9312 | 3.0 | 741 | 1.1661 | 0.6440 |
54
 
55
 
56
  ### Framework versions