alvarobartt HF Staff commited on
Commit
3616abf
·
verified ·
1 Parent(s): f7d1ce6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -26,7 +26,7 @@ besides that allowing to use it via SGLang without having to pull the repository
26
  to point to the tokenizer path, so that Grok-2 can be deployed as:
27
 
28
  ```bash
29
- python3 -m sglang.launch_server --model xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp 8 --quantization fp8 --attention-backend triton
30
  ```
31
 
32
  Rather than the former 2-step process:
@@ -34,7 +34,7 @@ Rather than the former 2-step process:
34
  ```bash
35
  hf download xai-org/grok-2 --local-dir /local/grok-2
36
 
37
- python3 -m sglang.launch_server --model /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp 8 --quantization fp8 --attention-backend triton
38
  ```
39
 
40
  ## Example
 
26
  to point to the tokenizer path, so that Grok-2 can be deployed as:
27
 
28
  ```bash
29
+ python3 -m sglang.launch_server --model-path xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp-size 8 --quantization fp8 --attention-backend triton
30
  ```
31
 
32
  Rather than the former 2-step process:
 
34
  ```bash
35
  hf download xai-org/grok-2 --local-dir /local/grok-2
36
 
37
+ python3 -m sglang.launch_server --model-path /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp-size 8 --quantization fp8 --attention-backend triton
38
  ```
39
 
40
  ## Example