fastapi
uvicorn
transformers
torch
accelerate
bitsandbytes