Spaces:

Fas1
/

capybara_fas_ai

Running

Fas1 commited on Jul 13

Commit

b042832

verified ·

1 Parent(s): 18c0927

ы

Files changed (1) hide show

app.py CHANGED Viewed

@@ -22,7 +22,7 @@ model = AutoModelForCausalLM.from_pretrained(
     token=hf_token,
     torch_dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
     device_map="auto",
-    offload_folder="offload",
     offload_state_dict=True,
     low_cpu_mem_usage=True,
     trust_remote_code=True,

     token=hf_token,
     torch_dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
     device_map="auto",
+    offload_dir="offload",
     offload_state_dict=True,
     low_cpu_mem_usage=True,
     trust_remote_code=True,