second-state
/

Phi-3-mini-4k-instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

apepkuss79 commited on Jul 9, 2024

Commit

8b281df

·

verified ·

1 Parent(s): c1a5c58

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ tags:
 ## Run with LlamaEdge
-- LlamaEdge version: [v0.8.4](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.8.4) and above
 - Prompt template
@@ -68,7 +68,7 @@ tags:
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf \
     llama-chat.wasm \
     --prompt-template phi-3-chat \
-    --ctx-size 4000 \
   ```
 ## Quantized GGUF Models

 ## Run with LlamaEdge
+- LlamaEdge version: [v0.12.2](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.12.2) and above
 - Prompt template
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf \
     llama-chat.wasm \
     --prompt-template phi-3-chat \
+    --ctx-size 4000
   ```
 ## Quantized GGUF Models