scripts/inference-server/requirements.txt

argparse
asyncio
aiohttp
numpy
torch==2.0.1 --index-url https://download.pytorch.org/whl/cu118
tqdm
zeus-ml