Spaces:

Abijith
/

cai-assignement2-group79

Sleeping

Abijith commited on Mar 16

Commit

7350601

verified ·

1 Parent(s): babfeb1

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -94,8 +94,6 @@ if uploaded_files:
         model = AutoModelForCausalLM.from_pretrained(
             model_name,
             trust_remote_code=True,
-            device_map="auto",  # For GPU acceleration
-            torch_dtype=torch.float16
         )
         # Create pipeline with generation parameters

         model = AutoModelForCausalLM.from_pretrained(
             model_name,
             trust_remote_code=True,
         )
         # Create pipeline with generation parameters