markoarnauto
commited on
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -18,13 +18,8 @@ python -m vllm.entrypoints.openai.api_server --model cortecs/Meta-Llama-3-70B-In
|
|
18 |
```
|
19 |
Access the model:
|
20 |
```
|
21 |
-
curl http://localhost:8000/v1/completions
|
22 |
-
|
23 |
-
-d '{
|
24 |
-
"model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ",
|
25 |
-
"prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>
|
26 |
-
Tell me a joke<|eot_id|><|start_header_id|>assistant<|end_header_id|>"
|
27 |
-
}'
|
28 |
```
|
29 |
|
30 |
## Evaluations
|
|
|
18 |
```
|
19 |
Access the model:
|
20 |
```
|
21 |
+
curl http://localhost:8000/v1/completions -H "Content-Type: application/json" -d "{"model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ", "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>
|
22 |
+
Tell me a joke<|eot_id|><|start_header_id|>assistant<|end_header_id|>"}"
|
|
|
|
|
|
|
|
|
|
|
23 |
```
|
24 |
|
25 |
## Evaluations
|