| --extra-index-url https://pypi.ngc.nvidia.com | |
| nvidia-cuda-runtime | |
| nvidia-cublas | |
| # llama-cpp-python @ https://github.com/OpenAccess-AI-Collective/ggml-webui/releases/download/v0.1.52-rc1/llama_cpp_python-gpu-0.1.52-cp38-cp38-linux_x86_64.whl | |
| llama-cpp-python @ https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.53/llama_cpp_python-0.1.53-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl | |
| pyyaml | |
| torch |