Update README.md
Browse files
README.md
CHANGED
@@ -78,14 +78,18 @@ So please first update text-genration-webui to the latest version.
|
|
78 |
|
79 |
## How to download and use this model in text-generation-webui
|
80 |
|
81 |
-
1. Launch text-generation-webui
|
82 |
2. Click the **Model tab**.
|
83 |
-
3.
|
84 |
-
4.
|
85 |
-
5.
|
86 |
-
6.
|
87 |
-
7.
|
88 |
-
8.
|
|
|
|
|
|
|
|
|
89 |
|
90 |
## About `trust_remote_code`
|
91 |
|
|
|
78 |
|
79 |
## How to download and use this model in text-generation-webui
|
80 |
|
81 |
+
1. Launch text-generation-webui
|
82 |
2. Click the **Model tab**.
|
83 |
+
3. Untick **Autoload model**
|
84 |
+
4. Under **Download custom model or LoRA**, enter `TheBloke/falcon-40B-instruct-GPTQ`.
|
85 |
+
5. Click **Download**.
|
86 |
+
6. Wait until it says it's finished downloading.
|
87 |
+
7. Click the **Refresh** icon next to **Model** in the top left.
|
88 |
+
8. In the **Model drop-down**: choose the model you just downloaded, `falcon-40B-instruct-GPTQ`.
|
89 |
+
9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
|
90 |
+
10. Tick **Trust Remote Code**, followed by **Save Settings**
|
91 |
+
11. Make sure Click **Reload**.
|
92 |
+
12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
|
93 |
|
94 |
## About `trust_remote_code`
|
95 |
|