ssaroya
/

gptq_model

Model card Files Files and versions

ssaroya commited on May 22, 2023

Commit

c77d578

·

1 Parent(s): 14d16ec

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -33,7 +33,7 @@ class EndpointHandler:
                 input_ids,
                 do_sample=True,
                 min_length=50,
-                max_length=200,
                 top_p=0.95,
                 temperature=0.8,
             )

                 input_ids,
                 do_sample=True,
                 min_length=50,
+                max_length=len(input_ids)+250,
                 top_p=0.95,
                 temperature=0.8,
             )