Hugging Face's logo

hf-internal-testing
/
test_dynamic_model_with_tokenizer

Feature Extraction
Transformers
PyTorch
new-model
custom_code
Model card Files
xet
Community
1
test_dynamic_model_with_tokenizer / tokenization.py
radames's picture
radames
Upload 6 files
3fe0c05
raw
history blame
112 Bytes
 from transformers import BertTokenizer
class NewTokenizer(BertTokenizer):
special_attribute_present =True