unsubscribe commited on
Commit
cafee21
·
verified ·
1 Parent(s): 4b3bebb

Update the installation of vllm in readme

Browse files
Files changed (1) hide show
  1. README.md +11 -30
README.md CHANGED
@@ -204,15 +204,10 @@ for chunk in stream:
204
 
205
  #### vLLM inference
206
 
207
- We are still working on merging the PR(https://github.com/vllm-project/vllm/pull/12037) into vLLM. In the meantime, please use the following PR link to install it manually.
208
 
209
  ```python
210
- git clone -b support-internlm3 https://github.com/RunningLeon/vllm.git
211
- # and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
212
- cd vllm
213
- python use_existing_torch.py
214
- pip install -r requirements-build.txt
215
- pip install -e . --no-build-isolatio
216
  ```
217
 
218
  inference code:
@@ -407,14 +402,10 @@ for chunk in stream:
407
 
408
  #### vLLM inference
409
 
410
- We are still working on merging the PR(https://github.com/vllm-project/vllm/pull/12037) into vLLM. In the meantime, please use the following PR link to install it manually.
 
411
  ```python
412
- git clone https://github.com/RunningLeon/vllm.git
413
- # and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
414
- cd vllm
415
- python use_existing_torch.py
416
- pip install -r requirements-build.txt
417
- pip install -e . --no-build-isolatio
418
  ```
419
 
420
  inference code
@@ -642,15 +633,10 @@ for chunk in stream:
642
 
643
  ##### vLLM 推理
644
 
645
- 我们还在推动PR(https://github.com/vllm-project/vllm/pull/12037) 合入vllm,现在请使用以下PR链接手动安装
646
 
647
- ```python
648
- git clone https://github.com/RunningLeon/vllm.git
649
- # and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
650
- cd vllm
651
- python use_existing_torch.py
652
- pip install -r requirements-build.txt
653
- pip install -e . --no-build-isolatio
654
  ```
655
 
656
  推理代码
@@ -844,15 +830,10 @@ for chunk in stream:
844
 
845
  ##### vLLM 推理
846
 
847
- 我们还在推动PR(https://github.com/vllm-project/vllm/pull/12037) 合入vllm,现在请使用以下PR链接手动安装
848
 
849
- ```python
850
- git clone https://github.com/RunningLeon/vllm.git
851
- # and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
852
- cd vllm
853
- python use_existing_torch.py
854
- pip install -r requirements-build.txt
855
- pip install -e . --no-build-isolatio
856
  ```
857
 
858
  推理代码
 
204
 
205
  #### vLLM inference
206
 
207
+ Refer to [installation](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) to install the latest code of vllm
208
 
209
  ```python
210
+ pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
 
 
 
 
 
211
  ```
212
 
213
  inference code:
 
402
 
403
  #### vLLM inference
404
 
405
+ Refer to [installation](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) to install the latest code of vllm
406
+
407
  ```python
408
+ pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
 
 
 
 
 
409
  ```
410
 
411
  inference code
 
633
 
634
  ##### vLLM 推理
635
 
636
+ 参考[文档](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) 安装 vllm 最新代码
637
 
638
+ ```bash
639
+ pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
 
 
 
 
 
640
  ```
641
 
642
  推理代码
 
830
 
831
  ##### vLLM 推理
832
 
833
+ 参考[文档](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) 安装 vllm 最新代码
834
 
835
+ ```bash
836
+ pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
 
 
 
 
 
837
  ```
838
 
839
  推理代码