Spaces:

pabloce
/

exllama

Running on Zero

File size: 327 Bytes

2f8c94b
fc9eab8
749c972
0784145
24d4f61
e85d9e5

huggingface_hub==0.31.1
tokenizers
numpy==2.2.5
https://github.com/turboderp-org/exllamav2/releases/download/v0.3.0/exllamav2-0.3.0+cu121.torch2.3.1-cp310-cp310-linux_x86_64.whl
https://github.com/Dao-AILab/flash-attention/releases/download/v2.7.3/flash_attn-2.7.3+cu12torch2.6cxx11abiFALSE-cp310-cp310-linux_x86_64.whl
jinja2