Spaces:
Paused
Paused
feat(runner.sh): add specific task and code revision
Browse files
runner.sh
CHANGED
@@ -24,10 +24,27 @@ esac
|
|
24 |
|
25 |
printf "Running %s using vLLM OpenAI compatible API Server at port %s\n" $MODEL_NAME "7860"
|
26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
# Run the Python script with the determined values
|
|
|
28 |
python -u /app/openai_compatible_api_server.py \
|
29 |
--model "${MODEL_NAME}" \
|
|
|
30 |
--revision "${MODEL_REV}" \
|
|
|
|
|
31 |
--seed 42 \
|
32 |
--host 0.0.0.0 \
|
33 |
--port 7860 \
|
|
|
24 |
|
25 |
printf "Running %s using vLLM OpenAI compatible API Server at port %s\n" $MODEL_NAME "7860"
|
26 |
|
27 |
+
# https://medium.com/geekculture/the-story-behind-random-seed-42-in-machine-learning-b838c4ac290a
|
28 |
+
#[Seven and a half million years later…. Fook and Lunkwill are long gone, but their descendants continue what they started]
|
29 |
+
# “All right,” said Deep Thought. “The Answer to the Great Question…”
|
30 |
+
# “Yes..!”
|
31 |
+
# “Of Life, the Universe and Everything…” said Deep Thought.
|
32 |
+
# “Yes…!”
|
33 |
+
# “Is…” said Deep Thought, and paused.
|
34 |
+
# “Yes…!”
|
35 |
+
# “Is…”
|
36 |
+
# “Yes…!!!…?”
|
37 |
+
# “Forty-two,” said Deep Thought, with infinite majesty and calm.”
|
38 |
+
|
39 |
+
# ―Douglas Adams, The Hitchhiker’s Guide to the Galaxy
|
40 |
# Run the Python script with the determined values
|
41 |
+
# Supported tasks: {'generate', 'embedding'}
|
42 |
python -u /app/openai_compatible_api_server.py \
|
43 |
--model "${MODEL_NAME}" \
|
44 |
+
--task generate \
|
45 |
--revision "${MODEL_REV}" \
|
46 |
+
--code-revision "${MODEL_REV}" \
|
47 |
+
--tokenizer-revision "${MODEL_REV}" \
|
48 |
--seed 42 \
|
49 |
--host 0.0.0.0 \
|
50 |
--port 7860 \
|