|
|
--- |
|
|
pipeline_tag: text-generation |
|
|
license: apache-2.0 |
|
|
language: |
|
|
- zh |
|
|
widget: |
|
|
- text: "你好啊，O(∩_∩)O哈哈~" |
|
|
example_title: "Sentiment analysis" |
|
|
- text: "Barack Obama nominated Hilary Clinton as his secretary of state on Monday. He chose her because she had ..." |
|
|
example_title: "向量化" |
|
|
- text: "On a shelf, there are five books: a gray book, a red book, a purple book, a blue book, and a black book ..." |
|
|
example_title: "Logic puzzles" |
|
|
- text: "The two men running to become New York City's next mayor will face off in their first debate Wednesday night ..." |
|
|
example_title: "Reading comprehension" |
|
|
--- |
|
|
### How to use |
|
|
```python |
|
|
from transformers import AutoTokenizer, AutoModel |
|
|
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm2-6b-int4", trust_remote_code=True) |
|
|
model = AutoModel.from_pretrained("THUDM/chatglm2-6b-int4", trust_remote_code=True).half().cuda() |
|
|
model = model.eval() |
|
|
text = "你好" |
|
|
response, history = model.chat(tokenizer, text, history=[]) |
|
|
response |
|
|
``` |
