Spaces:
Paused
Paused
Husnain
commited on
HF-LLM-API
Browse files
README.md
CHANGED
|
@@ -14,13 +14,13 @@ Project link: https://github.com/Niansuh/HF-LLM-API
|
|
| 14 |
|
| 15 |
## Features
|
| 16 |
|
| 17 |
-
- Available Models (2024/01/22): [#
|
| 18 |
- `mistral-7b`, `mixtral-8x7b`, `nous-mixtral-8x7b`
|
| 19 |
- Adaptive prompt templates for different models
|
| 20 |
- Support OpenAI API format
|
| 21 |
- Enable api endpoint via official `openai-python` package
|
| 22 |
- Support both stream and no-stream response
|
| 23 |
-
- Support API Key via both HTTP auth header and env varible [#
|
| 24 |
- Docker deployment
|
| 25 |
|
| 26 |
## Run API service
|
|
|
|
| 14 |
|
| 15 |
## Features
|
| 16 |
|
| 17 |
+
- Available Models (2024/01/22): [#2](https://github.com/Niansuh/HF-LLM-API/issues/2)
|
| 18 |
- `mistral-7b`, `mixtral-8x7b`, `nous-mixtral-8x7b`
|
| 19 |
- Adaptive prompt templates for different models
|
| 20 |
- Support OpenAI API format
|
| 21 |
- Enable api endpoint via official `openai-python` package
|
| 22 |
- Support both stream and no-stream response
|
| 23 |
+
- Support API Key via both HTTP auth header and env varible [#1](https://github.com/Niansuh/HF-LLM-API/issues/1)
|
| 24 |
- Docker deployment
|
| 25 |
|
| 26 |
## Run API service
|