YYSH
/

Test-demo-colab

Test-demo-colab / special_tokens_map.json

add tokenizer

9061d9f about 3 years ago

85 Bytes

{"bos_token": "<s>", "eos_token": "</s>", "unk_token": "[UNK]", "pad_token": "[PAD]"}