Hugging Face's logo

hf-internal-testing
/
tiny-random-OPTForCausalLM

Text Generation
Transformers
PyTorch
TensorFlow
ONNX
opt
text-generation-inference
Model card Files Community
5

Update tokenizer files (and add tokenizer.json)

#3
by Xenova HF Staff - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+100394
-50300
Update tokenizer files (and add tokenizer.json)84ece701
Xenova
 Hugging Face Internal Testing Organization org

Exported with tokenizer.save_pretrained(...) (latest transformers version)

Xenova
 Hugging Face Internal Testing Organization org

Quite a large diff, so if anything, we can just update the tokenizer.json file.

Xenova changed pull request status to merged

Sign up or log in to comment