File size: 797 Bytes
18f89ce 9d6da01 0829c8a 18f89ce 21b8737 158e208 21b8737 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
---
license: mit
language:
- en
---
# VizWiz-Bert model (uncased)
Fine-tuning the BERT-base model for the Fill Mask task in [VizWiz-Vision Skills for VQA](https://vizwiz.org/tasks-and-datasets/vision-skills/)
## Fine-tuining information
* model: **bert-base-uncased**
* downstream_tasks: **fill-mask**
## Dataset information
* [annotations](https://github.com/chiutaiyin/Vision-Skills/tree/master/csv) (CSV files)
* size: **~22K**
* max_token_len: **78**
## Training information
* random_seed: **16**
* max_token_len: **78**
* train_batch_size: **32**
* val_batch_size: **16**
* num_epochs: **5**,
* learning_rate: **5e-06**,
* split_train: **0.8**
* optimizer: **adamw**
## Learning curves
|