transformers
torch
accelerate
vllm==0.5.3.post1
flash-attn==2.6.3
gradio