Dhahlan2000 commited on
Commit
3ce6b08
·
1 Parent(s): 1102518

Refactor app.py to remove device_map parameter from model initialization, simplifying the configuration for text generation. This change enhances code clarity and focuses on essential parameters.

Browse files
Files changed (1) hide show
  1. app.py +0 -1
app.py CHANGED
@@ -65,7 +65,6 @@ if access_token:
65
  model = AutoModelForCausalLM.from_pretrained(
66
  "google/gemma-2b-it",
67
  token=access_token,
68
- device_map="auto" # Better device handling
69
  )
70
  return pipeline(
71
  "text-generation",
 
65
  model = AutoModelForCausalLM.from_pretrained(
66
  "google/gemma-2b-it",
67
  token=access_token,
 
68
  )
69
  return pipeline(
70
  "text-generation",