Spaces:

husseinelsaadi
/

ai-interviewer-demo

Paused

husseinelsaadi commited on 5 days ago

Commit

0fc5746

verified ·

1 Parent(s): 33790e9

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -134,7 +134,8 @@ tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH)
 model = AutoModelForCausalLM.from_pretrained(
     MODEL_PATH,
     torch_dtype=torch.bfloat16 if torch.backends.mps.is_available() else torch.float32,
-    device_map="auto"
 )
 falcon_pipeline = pipeline(

 model = AutoModelForCausalLM.from_pretrained(
     MODEL_PATH,
     torch_dtype=torch.bfloat16 if torch.backends.mps.is_available() else torch.float32,
+    device_map="auto",
+    offload_folder="offload"
 )
 falcon_pipeline = pipeline(