hf-internal-testing

/

tiny-random-T5ForConditionalGeneration

like 1

Follow

Hugging Face Internal Testing Organization 130

When trying to download, I get the following error:

2023-03-03 08:45:05,886 [INFO] __main__: Downloading model hf-internal-testing/tiny-random-T5ForConditionalGeneration to models/hf-internal-testing/tiny-random-T5ForConditionalGeneration.
Traceback (most recent call last):
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/viktor/git/ml/src/functions/question_extractor/src/download_models.py", line 21, in <module>
    download_models()
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/site-packages/utils/profile.py", line 16, in inner_wrapper
    result = func(*args, **kwargs)
  File "/Users/viktor/git/ml/src/functions/question_extractor/src/download_models.py", line 13, in download_models
    tokenizer = T5Tokenizer.from_pretrained(MODEL_NAME)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 1804, in from_pretrained
    return cls._from_pretrained(
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 1959, in _from_pretrained
    tokenizer = cls(*init_inputs, **init_kwargs)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/site-packages/transformers/models/t5/tokenization_t5.py", line 154, in __init__
    self.sp_model.Load(vocab_file)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/site-packages/sentencepiece/__init__.py", line 905, in Load
    return self.LoadFromFile(model_file)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/ml-dev/lib/python3.9/site-packages/sentencepiece/__init__.py", line 310, in LoadFromFile
    return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
TypeError: not a string

Seems like the spiece.model is missing when comparing this repo to other T5 models for conditional generation, this one for example.