Spaces:

Didier
/

Mistral_Small_AutoRound

Sleeping

Didier commited on 12 days ago

Commit

1136305

verified ·

1 Parent(s): b643576

Update vlm.py

Files changed (1) hide show

vlm.py CHANGED Viewed

@@ -17,7 +17,7 @@ device = 'cuda' if torch.cuda.is_available() else 'cpu'
 processor = AutoProcessor.from_pretrained(model_id)
 model = Mistral3ForConditionalGeneration.from_pretrained(
     model_id,
-    _attn_implementation="flash_attention_2",
     torch_dtype=torch.bfloat16
 ).eval().to(device)

 processor = AutoProcessor.from_pretrained(model_id)
 model = Mistral3ForConditionalGeneration.from_pretrained(
     model_id,
+    #_attn_implementation="flash_attention_2",
     torch_dtype=torch.bfloat16
 ).eval().to(device)