transformers>=4.30.0
auto-gptq
torch
einops
gradio