Spaces:
Configuration error
Configuration error
Add poetry install shell cmd to the readme (#7)
Browse files* Add poetry install shell cmd to the readme
Signed-off-by: Brent Salisbury <[email protected]>
* Add GPU support instructions
- Validated on an EC2 GPU instance to work.
- Closes #8
Signed-off-by: Brent Salisbury <[email protected]>
* Update README.md
Signed-off-by: Anil Vishnoi <[email protected]>
---------
Signed-off-by: Brent Salisbury <[email protected]>
Signed-off-by: Anil Vishnoi <[email protected]>
Co-authored-by: Anil Vishnoi <[email protected]>
README.md
CHANGED
@@ -10,6 +10,9 @@
|
|
10 |
Install the dependencies
|
11 |
|
12 |
```sh
|
|
|
|
|
|
|
13 |
# Install dependencies
|
14 |
poetry install
|
15 |
|
@@ -30,3 +33,24 @@ curl -X 'POST' \
|
|
30 |
}
|
31 |
}'
|
32 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
Install the dependencies
|
11 |
|
12 |
```sh
|
13 |
+
# Install poetry if not already available
|
14 |
+
curl -sSL https://install.python-poetry.org | python3 -
|
15 |
+
|
16 |
# Install dependencies
|
17 |
poetry install
|
18 |
|
|
|
33 |
}
|
34 |
}'
|
35 |
```
|
36 |
+
|
37 |
+
### Cuda GPU Support
|
38 |
+
|
39 |
+
For GPU support try the following:
|
40 |
+
|
41 |
+
```sh
|
42 |
+
# Create a virtual env
|
43 |
+
python3 -m venv venv
|
44 |
+
|
45 |
+
# Activate the venv
|
46 |
+
source venv/bin/active
|
47 |
+
|
48 |
+
# Install torch with the special index
|
49 |
+
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
|
50 |
+
|
51 |
+
# Install the package
|
52 |
+
pip install -e .
|
53 |
+
|
54 |
+
# Run the server
|
55 |
+
poetry run uvicorn docling_serve.app:app --reload
|
56 |
+
```
|