Spaces:

Duplicated from Xenova/the-tokenizer-playground

Jhayase
/

superbpe-tokenizer-playground

Running

App Files Files Community

superbpe-tokenizer-playground / assets

Ctrl+K

Ctrl+K

2 contributors

History: 21 commits

Jhayase's picture

Set default to SuperBPE t180k

ee8ca32 5 months ago