Dhahlan2000 commited on
Commit
1102518
·
1 Parent(s): 9167e85

Update app.py to increase max_new_tokens for text generation from 512 to 2048, enhancing model output capacity. Remove 'accelerate' package from requirements.txt to streamline dependencies.

Browse files
Files changed (2) hide show
  1. app.py +1 -2
  2. requirements.txt +0 -1
app.py CHANGED
@@ -71,9 +71,8 @@ if access_token:
71
  "text-generation",
72
  model=model,
73
  tokenizer=tokenizer,
74
- max_new_tokens=512,
75
  temperature=0.7,
76
- do_sample=True,
77
  top_p=0.95
78
  )
79
  except Exception as e:
 
71
  "text-generation",
72
  model=model,
73
  tokenizer=tokenizer,
74
+ max_new_tokens=2048,
75
  temperature=0.7,
 
76
  top_p=0.95
77
  )
78
  except Exception as e:
requirements.txt CHANGED
@@ -5,5 +5,4 @@ langchain
5
  transformers
6
  torch
7
  PyPDF2
8
- accelerate
9
 
 
5
  transformers
6
  torch
7
  PyPDF2
 
8