Spaces:

abhijitkumarjha88192
/

testllmgr

Runtime error

abhijitkumarjha88192 commited on Jun 9, 2024

Commit

d2a8d6f

verified ·

1 Parent(s): 03c87f7

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -8,7 +8,7 @@ torch.random.manual_seed(0)
 model_id = "microsoft/Phi-3-medium-128k-instruct"
 model = AutoModelForCausalLM.from_pretrained(
     model_id,
-    device_map="cuda",
     torch_dtype="auto",
     trust_remote_code=True,
 )

 model_id = "microsoft/Phi-3-medium-128k-instruct"
 model = AutoModelForCausalLM.from_pretrained(
     model_id,
+    device_map="cpu",
     torch_dtype="auto",
     trust_remote_code=True,
 )