alvarobartt
/

grok-2-tokenizer

Model card Files Files and versions

alvarobartt HF Staff commited on 25 days ago

Commit

dbe8bab

·

verified ·

1 Parent(s): 495701d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ license_link: https://huggingface.co/xai-org/grok-2/blob/main/LICENSE
 # Grok-2 Tokenizer
-A 🤗-compatible version of the **Grok-2 tokenizer** (adapted from [xai-org/grok-2](https://github.com/xai-org/grok-2)).
 This means it can be used with Hugging Face libraries including [Transformers](https://github.com/huggingface/transformers),
 [Tokenizers](https://github.com/huggingface/tokenizers), and [Transformers.js](https://github.com/xenova/transformers.js).

 # Grok-2 Tokenizer
+A 🤗-compatible version of the **Grok-2 tokenizer** (adapted from [xai-org/grok-2](https://huggingface.co/xai-org/grok-2)).
 This means it can be used with Hugging Face libraries including [Transformers](https://github.com/huggingface/transformers),
 [Tokenizers](https://github.com/huggingface/tokenizers), and [Transformers.js](https://github.com/xenova/transformers.js).