Spaces:

Mdrnfox
/

peft-bench-eval

Sleeping

Mdrnfox commited on Jun 13

Commit

a3cd329

verified ·

1 Parent(s): 86b9502

Update run_eval.py

Files changed (1) hide show

run_eval.py CHANGED Viewed

@@ -122,6 +122,9 @@ for cfg in CONFIGS:
             print("Invalid tokenizer loaded. Skipping.")
             continue
         hf_lm = HFLM(
             pretrained=td,
             batch_size=8 if not is_encoder else 16,

             print("Invalid tokenizer loaded. Skipping.")
             continue
+        device = "cuda" if torch.cuda.is_available() else "cpu"
         hf_lm = HFLM(
             pretrained=td,
             batch_size=8 if not is_encoder else 16,