Commit
·
b0e76f1
1
Parent(s):
9765282
Update README.md
Browse files
README.md
CHANGED
@@ -22,6 +22,6 @@ tokenizer.decode([10163, 46387]) # '<unused123> pigeon'
|
|
22 |
gpt2_tokenizer.decode([10163, 46387]) # '123 pigeon'
|
23 |
```
|
24 |
|
25 |
-
- This is for my investigations into the arithmetic capabilities of large language models.
|
26 |
- [PaLM](https://arxiv.org/abs/2204.02311) does this.
|
27 |
- Many models (illustriously, [GPT-3](https://arxiv.org/abs/2005.14165)) use the GPT-2 tokenizer, which doesn't do this.
|
|
|
22 |
gpt2_tokenizer.decode([10163, 46387]) # '123 pigeon'
|
23 |
```
|
24 |
|
25 |
+
- This is for my investigations into the arithmetic capabilities of large language models. There is no model here, only a tokenizer.
|
26 |
- [PaLM](https://arxiv.org/abs/2204.02311) does this.
|
27 |
- Many models (illustriously, [GPT-3](https://arxiv.org/abs/2005.14165)) use the GPT-2 tokenizer, which doesn't do this.
|