Spaces:

TWO
/

sutra-tokenizer-comparison

Running

App Files Files Community

sutra-tokenizer-comparison / data

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

Michael Sapienza

adding more examples

5be3066 about 1 year ago

multilingualphrases01.txt

24.4 kB

adding sutra tokenizer inspector app about 1 year ago
multilingualphrases02.txt

11.3 kB

adding sutra tokenizer inspector app about 1 year ago
multilingualphrases03.txt

6.51 kB

adding more examples about 1 year ago