Spaces:
Running
Running
File size: 2,027 Bytes
1152dbd f3fb90e 1152dbd 398490c e954af3 1538605 1152dbd f3fb90e 78aed5c 70c8978 3f2cd63 78aed5c f3fb90e 78aed5c f3fb90e 78aed5c cba9b67 a23680a a4e032e dc8d591 a4e032e d13f9cf a4e032e d13f9cf a4e032e dc8d591 d13f9cf 78aed5c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
---
title: chat-ui
emoji: 🔥
colorFrom: purple
colorTo: purple
sdk: docker
pinned: false
license: apache-2.0
base_path: /chat
app_port: 3000
---
# Chat UI
A chat interface using open source models, eg OpenAssistant. It is a SvelteKit app and it powers the [HuggingChat app on hf.co/chat](https://huggingface.co/chat).
## Launch
```bash
npm install
npm run dev
```
## Environment
Default configuration is in `.env`. Put custom config and secrets in `.env.local`, it will override the values in `.env`.
Check out [.env](./.env) to see what needs to be set.
Basically you need to create a `.env.local` with the following contents:
```
MONGODB_URL=<url to mongo, for example a free MongoDB Atlas sandbox instance>
HF_ACCESS_TOKEN=<your HF access token from https://huggingface.co/settings/tokens>
```
## Duplicating to a Space
Create a `DOTENV_LOCAL` secret to your space with the following contents:
```
MONGODB_URL=<url to mongo, for example a free MongoDB Atlas sandbox instance>
HF_ACCESS_TOKEN=<your HF access token from https://huggingface.co/settings/tokens>
```
Where the contents in `<...>` are replaced by the MongoDB URL and your [HF Access Token](https://huggingface.co/settings/tokens).
## Running Local Inference
Both the example above use the HF Inference API or HF Endpoints API.
If you want to run the model locally, you need to run this inference server locally: https://github.com/huggingface/text-generation-inference
And add this to your `.env.local`:
```
MODELS=`[{"name": "...", "endpoints": [{"url": "127.0.0.1:8080/generate_stream"}]}]`
```
## Building
To create a production version of your app:
```bash
npm run build
```
You can preview the production build with `npm run preview`.
> To deploy your app, you may need to install an [adapter](https://kit.svelte.dev/docs/adapters) for your target environment.
|