unsubscribe
commited on
Update the installation of vllm in readme
Browse files
README.md
CHANGED
@@ -204,15 +204,10 @@ for chunk in stream:
|
|
204 |
|
205 |
#### vLLM inference
|
206 |
|
207 |
-
|
208 |
|
209 |
```python
|
210 |
-
|
211 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
212 |
-
cd vllm
|
213 |
-
python use_existing_torch.py
|
214 |
-
pip install -r requirements-build.txt
|
215 |
-
pip install -e . --no-build-isolatio
|
216 |
```
|
217 |
|
218 |
inference code:
|
@@ -407,14 +402,10 @@ for chunk in stream:
|
|
407 |
|
408 |
#### vLLM inference
|
409 |
|
410 |
-
|
|
|
411 |
```python
|
412 |
-
|
413 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
414 |
-
cd vllm
|
415 |
-
python use_existing_torch.py
|
416 |
-
pip install -r requirements-build.txt
|
417 |
-
pip install -e . --no-build-isolatio
|
418 |
```
|
419 |
|
420 |
inference code
|
@@ -642,15 +633,10 @@ for chunk in stream:
|
|
642 |
|
643 |
##### vLLM 推理
|
644 |
|
645 |
-
|
646 |
|
647 |
-
```
|
648 |
-
|
649 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
650 |
-
cd vllm
|
651 |
-
python use_existing_torch.py
|
652 |
-
pip install -r requirements-build.txt
|
653 |
-
pip install -e . --no-build-isolatio
|
654 |
```
|
655 |
|
656 |
推理代码
|
@@ -844,15 +830,10 @@ for chunk in stream:
|
|
844 |
|
845 |
##### vLLM 推理
|
846 |
|
847 |
-
|
848 |
|
849 |
-
```
|
850 |
-
|
851 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
852 |
-
cd vllm
|
853 |
-
python use_existing_torch.py
|
854 |
-
pip install -r requirements-build.txt
|
855 |
-
pip install -e . --no-build-isolatio
|
856 |
```
|
857 |
|
858 |
推理代码
|
|
|
204 |
|
205 |
#### vLLM inference
|
206 |
|
207 |
+
Refer to [installation](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) to install the latest code of vllm
|
208 |
|
209 |
```python
|
210 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
211 |
```
|
212 |
|
213 |
inference code:
|
|
|
402 |
|
403 |
#### vLLM inference
|
404 |
|
405 |
+
Refer to [installation](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) to install the latest code of vllm
|
406 |
+
|
407 |
```python
|
408 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
409 |
```
|
410 |
|
411 |
inference code
|
|
|
633 |
|
634 |
##### vLLM 推理
|
635 |
|
636 |
+
参考[文档](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) 安装 vllm 最新代码
|
637 |
|
638 |
+
```bash
|
639 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
640 |
```
|
641 |
|
642 |
推理代码
|
|
|
830 |
|
831 |
##### vLLM 推理
|
832 |
|
833 |
+
参考[文档](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) 安装 vllm 最新代码
|
834 |
|
835 |
+
```bash
|
836 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
837 |
```
|
838 |
|
839 |
推理代码
|