Spaces:

FantasticGNU
/

AnomalyGPT

Runtime error

FantasticGNU commited on Aug 29, 2023

Commit

1b250fd

1 Parent(s): aa620b9

Update model/openllama.py

Files changed (1) hide show

model/openllama.py CHANGED Viewed

@@ -199,7 +199,7 @@ class OpenLLAMAPEFTModel(nn.Module):
             target_modules=['q_proj', 'k_proj', 'v_proj', 'o_proj']
         )
-        self.llama_model = LlamaForCausalLM.from_pretrained(vicuna_ckpt_path, low_cpu_mem_usage=True)
         self.llama_model = get_peft_model(self.llama_model, peft_config)
         self.llama_model.print_trainable_parameters()

             target_modules=['q_proj', 'k_proj', 'v_proj', 'o_proj']
         )
+        self.llama_model = LlamaForCausalLM.from_pretrained(vicuna_ckpt_path, low_cpu_mem_usage=True, torch_dtype=torch.bfloat16)
         self.llama_model = get_peft_model(self.llama_model, peft_config)
         self.llama_model.print_trainable_parameters()