markoarnauto commited on
Commit
f953275
·
verified ·
1 Parent(s): 709e374

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -7
README.md CHANGED
@@ -18,13 +18,8 @@ python -m vllm.entrypoints.openai.api_server --model cortecs/Meta-Llama-3-70B-In
18
  ```
19
  Access the model:
20
  ```
21
- curl http://localhost:8000/v1/completions
22
- -H "Content-Type: application/json"
23
- -d '{
24
- "model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ",
25
- "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>
26
- Tell me a joke<|eot_id|><|start_header_id|>assistant<|end_header_id|>"
27
- }'
28
  ```
29
 
30
  ## Evaluations
 
18
  ```
19
  Access the model:
20
  ```
21
+ curl http://localhost:8000/v1/completions -H "Content-Type: application/json" -d "{"model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ", "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>
22
+ Tell me a joke<|eot_id|><|start_header_id|>assistant<|end_header_id|>"}"
 
 
 
 
 
23
  ```
24
 
25
  ## Evaluations