Spaces:
Sleeping
Sleeping
Commit
·
3ce6b08
1
Parent(s):
1102518
Refactor app.py to remove device_map parameter from model initialization, simplifying the configuration for text generation. This change enhances code clarity and focuses on essential parameters.
Browse files
app.py
CHANGED
@@ -65,7 +65,6 @@ if access_token:
|
|
65 |
model = AutoModelForCausalLM.from_pretrained(
|
66 |
"google/gemma-2b-it",
|
67 |
token=access_token,
|
68 |
-
device_map="auto" # Better device handling
|
69 |
)
|
70 |
return pipeline(
|
71 |
"text-generation",
|
|
|
65 |
model = AutoModelForCausalLM.from_pretrained(
|
66 |
"google/gemma-2b-it",
|
67 |
token=access_token,
|
|
|
68 |
)
|
69 |
return pipeline(
|
70 |
"text-generation",
|