Spaces:
Sleeping
Sleeping
Commit
·
1102518
1
Parent(s):
9167e85
Update app.py to increase max_new_tokens for text generation from 512 to 2048, enhancing model output capacity. Remove 'accelerate' package from requirements.txt to streamline dependencies.
Browse files- app.py +1 -2
- requirements.txt +0 -1
app.py
CHANGED
@@ -71,9 +71,8 @@ if access_token:
|
|
71 |
"text-generation",
|
72 |
model=model,
|
73 |
tokenizer=tokenizer,
|
74 |
-
max_new_tokens=
|
75 |
temperature=0.7,
|
76 |
-
do_sample=True,
|
77 |
top_p=0.95
|
78 |
)
|
79 |
except Exception as e:
|
|
|
71 |
"text-generation",
|
72 |
model=model,
|
73 |
tokenizer=tokenizer,
|
74 |
+
max_new_tokens=2048,
|
75 |
temperature=0.7,
|
|
|
76 |
top_p=0.95
|
77 |
)
|
78 |
except Exception as e:
|
requirements.txt
CHANGED
@@ -5,5 +5,4 @@ langchain
|
|
5 |
transformers
|
6 |
torch
|
7 |
PyPDF2
|
8 |
-
accelerate
|
9 |
|
|
|
5 |
transformers
|
6 |
torch
|
7 |
PyPDF2
|
|
|
8 |
|