grant_rag_system

Running

Tesneem commited on 24 days ago

Commit

7ca40a8

verified ·

1 Parent(s): 1a6953b

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -283,7 +283,7 @@ PROMPTS:
         inputs = tokenizer(prompt, return_tensors="pt", truncation=True)
         outputs = model.generate(
             **inputs,
-            max_new_tokens=512,
             temperature=0.3,
             do_sample=False,
             pad_token_id=tokenizer.eos_token_id

         inputs = tokenizer(prompt, return_tensors="pt", truncation=True)
         outputs = model.generate(
             **inputs,
+            max_new_tokens=min(ax_tokens,512),
             temperature=0.3,
             do_sample=False,
             pad_token_id=tokenizer.eos_token_id