markhsu0818's picture
Upload folder using huggingface_hub
f44373f verified
metadata
library_name: transformers
tags:
  - llama-factory
license: mit
datasets:
  - OALL/details_unsloth__llama-3-8b-bnb-4bit
language:
  - zh

將模型下載到Ollama當中使用

Ollama只支援GGUF檔喔,請先參考我的github,產生量化模型檔

請先安裝huggingface-hub

pip install huggingface-hub

登入huggingface-cli

huggingface-cli login

image/png

上傳單個檔案(量化模型)

huggingface-cli upload markhsu0818/LLamaTrainModel Llama3-8B-Chinese-Chat-Q4-terry-new.gguf ^
https://huggingface.co/markhsu0818/LLamaTrainModel/

下載單個檔案(量化模型)

huggingface-cli download markhsu0818/LLamaTrainModel ^
Llama3-8B-Chinese-Chat-Q4-terry-new.gguf ^
--local-dir downloads ^
--local-dir-use-symlinks False

image/png

下載整個專案

Huggingface-cli download markhsu0818/LLamaTrainModel

image/png

參考連結

將 Hugging Face 上的模型安裝到 OLlama