Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ besides that allowing to use it via SGLang without having to pull the repository
|
|
26 |
to point to the tokenizer path, so that Grok-2 can be deployed as:
|
27 |
|
28 |
```bash
|
29 |
-
python3 -m sglang.launch_server --model xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp 8 --quantization fp8 --attention-backend triton
|
30 |
```
|
31 |
|
32 |
Rather than the former 2-step process:
|
@@ -34,7 +34,7 @@ Rather than the former 2-step process:
|
|
34 |
```bash
|
35 |
hf download xai-org/grok-2 --local-dir /local/grok-2
|
36 |
|
37 |
-
python3 -m sglang.launch_server --model /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp 8 --quantization fp8 --attention-backend triton
|
38 |
```
|
39 |
|
40 |
## Example
|
|
|
26 |
to point to the tokenizer path, so that Grok-2 can be deployed as:
|
27 |
|
28 |
```bash
|
29 |
+
python3 -m sglang.launch_server --model-path xai-org/grok-2 --tokenizer-path alvarobartt/grok-2-tokenizer --tp-size 8 --quantization fp8 --attention-backend triton
|
30 |
```
|
31 |
|
32 |
Rather than the former 2-step process:
|
|
|
34 |
```bash
|
35 |
hf download xai-org/grok-2 --local-dir /local/grok-2
|
36 |
|
37 |
+
python3 -m sglang.launch_server --model-path /local/grok-2 --tokenizer-path /local/grok-2/tokenizer.tok.json --tp-size 8 --quantization fp8 --attention-backend triton
|
38 |
```
|
39 |
|
40 |
## Example
|