update model card README.md

README.md

@@ -14,8 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/wav2vec2-large-robust-ft-swbd-300h](https://huggingface.co/facebook/wav2vec2-large-robust-ft-swbd-300h) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.5060
-- Wer: 0.3620
+- Loss: 0.5214
+- Wer: 0.7269
 
 ## Model description
 
@@ -34,32 +34,40 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
-- train_batch_size: 7
-- eval_batch_size: 8
+- learning_rate: 0.0004
+- train_batch_size: 4
+- eval_batch_size: 4
 - seed: 42
+- gradient_accumulation_steps: 20
+- total_train_batch_size: 80
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 1000
-- num_epochs: 3
+- lr_scheduler_warmup_steps: 150
+- num_epochs: 20
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step  | Validation Loss | Wer    |
-|:-------------:|:-----:|:-----:|:---------------:|:------:|
-| 0.8809        | 0.44  | 10000 | 0.6088          | 0.4008 |
-| 0.8435        | 0.77  | 20000 | 0.6319          | 0.3914 |
-| 0.7454        | 1.15  | 30000 | 0.6126          | 0.3809 |
-| 0.6806        | 1.53  | 40000 | 0.5307          | 0.3792 |
-| 0.6589        | 1.91  | 50000 | 0.5430          | 0.3710 |
-| 0.603         | 2.3   | 60000 | 0.5298          | 0.3646 |
-| 0.5886        | 2.68  | 70000 | 0.5060          | 0.3620 |
+| Training Loss | Epoch | Step | Validation Loss | Wer    |
+|:-------------:|:-----:|:----:|:---------------:|:------:|
+| 3.0565        | 0.09  | 250  | 3.0007          | 1.0    |
+| 1.4935        | 0.18  | 500  | 1.0356          | 0.8593 |
+| 1.1937        | 0.26  | 750  | 0.7995          | 0.5973 |
+| 1.0645        | 0.35  | 1000 | 0.6634          | 0.7798 |
+| 0.9923        | 0.44  | 1250 | 0.6355          | 0.7755 |
+| 0.9494        | 0.53  | 1500 | 0.6208          | 0.7647 |
+| 0.9503        | 0.61  | 1750 | 0.5996          | 0.5880 |
+| 0.9111        | 0.7   | 2000 | 0.5775          | 0.5689 |
+| 0.9027        | 0.79  | 2250 | 0.5761          | 0.6729 |
+| 0.8943        | 0.88  | 2500 | 0.5407          | 0.6768 |
+| 0.8671        | 0.96  | 2750 | 0.5257          | 0.6955 |
+| 0.823         | 1.05  | 3000 | 0.5520          | 0.8153 |
+| 0.8279        | 1.14  | 3250 | 0.5214          | 0.7269 |
 
 
 ### Framework versions
 
-- Transformers 4.17.0
+- Transformers 4.18.0
 - Pytorch 1.11.0+cu113
 - Datasets 1.18.4
 - Tokenizers 0.11.6