allstax
/

CodeExplainer-7b-v0.1

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

allstax commited on Dec 16, 2023

Commit

4756927

·

1 Parent(s): 61b895b

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -24,8 +24,9 @@ Prompt Template for alpaca style
 ```
 # Loading the model
 from transformers import AutoModelForCausalLM, AutoTokenizer, GPTQConfig
 model_id = "allstax/CodeExplainer-7b-v0.1"
 tokenizer = AutoTokenizer.from_pretrained(model_id)
-quant_model = AutoModelForCausalLM.from_pretrained(model_id, device_map='auto')

 ```
 # Loading the model
+```
 from transformers import AutoModelForCausalLM, AutoTokenizer, GPTQConfig
 model_id = "allstax/CodeExplainer-7b-v0.1"
 tokenizer = AutoTokenizer.from_pretrained(model_id)
+quant_model = AutoModelForCausalLM.from_pretrained(model_id, device_map='auto')
+```