Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ widget:
|
|
| 8 |
|
| 9 |
ViSoBERT is the state-of-the-art language model for Vietnamese social media tasks:
|
| 10 |
|
| 11 |
-
- ViSoBERT is the first monolingual MLM (XLM-R architecture)
|
| 12 |
- ViSoBERT outperforms previous monolingual, multilingual, and multilingual social media approaches, obtaining new state-of-the-art performances on four downstream Vietnamese social media tasks.
|
| 13 |
|
| 14 |
The general architecture and experimental results of ViSoBERT can be found in our [paper](https://arxiv.org/abs/2310.11166):
|
|
@@ -34,7 +34,7 @@ Install `transformers` and `SentencePiece` packages:
|
|
| 34 |
|
| 35 |
**Example usage**
|
| 36 |
```python
|
| 37 |
-
from transformers import AutoModel,AutoTokenizer
|
| 38 |
import torch
|
| 39 |
|
| 40 |
model= AutoModel.from_pretrained('uitnlp/visobert')
|
|
|
|
| 8 |
|
| 9 |
ViSoBERT is the state-of-the-art language model for Vietnamese social media tasks:
|
| 10 |
|
| 11 |
+
- ViSoBERT is the first monolingual MLM ([XLM-R](https://github.com/facebookresearch/XLM#xlm-r-new-model) architecture) built specifically for Vietnamese social media texts.
|
| 12 |
- ViSoBERT outperforms previous monolingual, multilingual, and multilingual social media approaches, obtaining new state-of-the-art performances on four downstream Vietnamese social media tasks.
|
| 13 |
|
| 14 |
The general architecture and experimental results of ViSoBERT can be found in our [paper](https://arxiv.org/abs/2310.11166):
|
|
|
|
| 34 |
|
| 35 |
**Example usage**
|
| 36 |
```python
|
| 37 |
+
from transformers import AutoModel, AutoTokenizer
|
| 38 |
import torch
|
| 39 |
|
| 40 |
model= AutoModel.from_pretrained('uitnlp/visobert')
|