metadata
library_name: transformers
tags:
- llama-factory
license: mit
datasets:
- OALL/details_unsloth__llama-3-8b-bnb-4bit
language:
- zh
將模型下載到Ollama當中使用
Ollama只支援
GGUF
檔喔,請先參考我的github,產生量化模型檔
請先安裝huggingface-hub
pip install huggingface-hub
登入huggingface-cli
huggingface-cli login
上傳單個檔案(量化模型)
huggingface-cli upload markhsu0818/LLamaTrainModel Llama3-8B-Chinese-Chat-Q4-terry-new.gguf ^
https://huggingface.co/markhsu0818/LLamaTrainModel/
下載單個檔案(量化模型)
huggingface-cli download markhsu0818/LLamaTrainModel ^
Llama3-8B-Chinese-Chat-Q4-terry-new.gguf ^
--local-dir downloads ^
--local-dir-use-symlinks False
下載整個專案
Huggingface-cli download markhsu0818/LLamaTrainModel