Update README.md
Browse files
README.md
CHANGED
@@ -283,7 +283,7 @@ evalplus.evaluate \
|
|
283 |
## Inference Performance
|
284 |
|
285 |
|
286 |
-
This model achieves up to
|
287 |
The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
|
288 |
|
289 |
<details>
|
|
|
283 |
## Inference Performance
|
284 |
|
285 |
|
286 |
+
This model achieves up to 2.47x speedup in single-stream deployment and up to 1.74x speedup in multi-stream asynchronous deployment, depending on hardware and use-case scenario.
|
287 |
The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
|
288 |
|
289 |
<details>
|