Rook / gpt2tokenizer_config.json
gaur3009's picture
Create gpt2tokenizer_config.json
28704a9 verified
raw
history blame contribute delete
88 Bytes
{
"model_max_length": 1024,
"padding_side": "right",
"truncation_side": "right"
}