Commit
·
e3e7f3e
1
Parent(s):
332c5af
Update README.md
Browse files
README.md
CHANGED
@@ -158,7 +158,7 @@ According to [the official paper](https://arxiv.org/abs/2105.03824) (*cf.* with
|
|
158 |
The following table contains test results on the HuggingFace model in comparison with [bert-base-cased](https://hf.co/models/bert-base-cased). The training was done on a single 16GB NVIDIA Tesla V100 GPU. For MRPC/WNLI, the models were trained for 5 epochs, while for other tasks, the models were trained for 3 epochs. Please refer to the checkpoints linked with the scores. The sequence length used for 512 with batch size 16 and learning rate 2e-5.
|
159 |
|
160 |
| Task | Metric | Result | | | Training time | |
|
161 |
-
| ----- | ---------------------- |
|
162 |
| | | Bert (PyTorch) - Reproduced | FNet (PyTorch) - Reproduced | FNet (Flax) - Official | Bert | FNet |
|
163 |
| MNLI | Accuracy | [84.10](https://huggingface.co/gchhablani/bert-base-cased-finetuned-mnli) | [76.75](https://huggingface.co/gchhablani/fnet-base-finetuned-mnli) | 72/73 (Match/Mismatch) | 09:52:33 | 06:40:55 |
|
164 |
| QQP | mean(Accuracy,F1) | [89.26](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qqp) | [86.5](https://huggingface.co/gchhablani/fnet-base-finetuned-qqp) | | 09:25:01 | 06:21:16 |
|
|
|
158 |
The following table contains test results on the HuggingFace model in comparison with [bert-base-cased](https://hf.co/models/bert-base-cased). The training was done on a single 16GB NVIDIA Tesla V100 GPU. For MRPC/WNLI, the models were trained for 5 epochs, while for other tasks, the models were trained for 3 epochs. Please refer to the checkpoints linked with the scores. The sequence length used for 512 with batch size 16 and learning rate 2e-5.
|
159 |
|
160 |
| Task | Metric | Result | | | Training time | |
|
161 |
+
| ----- | ---------------------- | --------------------------------------------------------------|----------------- | ------------------------------------------------------------------------- | ------------- | -------- |
|
162 |
| | | Bert (PyTorch) - Reproduced | FNet (PyTorch) - Reproduced | FNet (Flax) - Official | Bert | FNet |
|
163 |
| MNLI | Accuracy | [84.10](https://huggingface.co/gchhablani/bert-base-cased-finetuned-mnli) | [76.75](https://huggingface.co/gchhablani/fnet-base-finetuned-mnli) | 72/73 (Match/Mismatch) | 09:52:33 | 06:40:55 |
|
164 |
| QQP | mean(Accuracy,F1) | [89.26](https://huggingface.co/gchhablani/bert-base-cased-finetuned-qqp) | [86.5](https://huggingface.co/gchhablani/fnet-base-finetuned-qqp) | | 09:25:01 | 06:21:16 |
|