torch
transformers
fastapi
uvicorn
accelerate>=0.26.0
bitsandbytes