Transformers
cyrilzhang commited on
Commit
9765282
·
1 Parent(s): 8ae4896

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -22,4 +22,6 @@ tokenizer.decode([10163, 46387]) # '<unused123> pigeon'
22
  gpt2_tokenizer.decode([10163, 46387]) # '123 pigeon'
23
  ```
24
 
25
- [PaLM](https://arxiv.org/abs/2204.02311) does this.
 
 
 
22
  gpt2_tokenizer.decode([10163, 46387]) # '123 pigeon'
23
  ```
24
 
25
+ - This is for my investigations into the arithmetic capabilities of large language models.
26
+ - [PaLM](https://arxiv.org/abs/2204.02311) does this.
27
+ - Many models (illustriously, [GPT-3](https://arxiv.org/abs/2005.14165)) use the GPT-2 tokenizer, which doesn't do this.