is the model support TGI?

#152

by AminSharif - opened 27 days ago

27 days ago

i have served the model using transformers serve command on 2 RTX 3080 ti with 12GB VRAM for each one and i have latency
can i use TGI method?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment