Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
yusufs
/
vllm-inference
like
0
Paused
App
Files
Files
Fetching metadata from the HF Docker repository...
490e6a3
vllm-inference
1 contributor
History:
46 commits
yusufs
feat(runner.sh): using MODEL_ID only
490e6a3
about 1 month ago
.gitignore
Safe
19 Bytes
feat(download_model.py): remove download_model.py during build, it causing big image size
2 months ago
Dockerfile
Safe
1.32 kB
feat(runner.sh): using runner.sh to select llm in the run time
about 1 month ago
README.md
Safe
1.73 kB
feat(add-model): always download model during build, it will be cached in the consecutive builds
2 months ago
download_model.py
Safe
700 Bytes
feat(add-model): always download model during build, it will be cached in the consecutive builds
2 months ago
main.py
Safe
6.7 kB
feat(parse): parse output
2 months ago
openai_compatible_api_server.py
Safe
24.4 kB
feat(dep_sizes.txt): removes dep_sizes.txt during build, it not needed
2 months ago
poetry.lock
Safe
426 kB
feat(refactor): move the files to root
2 months ago
pyproject.toml
Safe
416 Bytes
feat(refactor): move the files to root
2 months ago
requirements.txt
Safe
9.99 kB
feat(first-commit): follow examples and tutorials
2 months ago
run-llama.sh
Safe
1.53 kB
feat(seed): Random seed for reproducibility.
about 1 month ago
run-sailor.sh
Safe
1.85 kB
feat(seed): Random seed for reproducibility.
about 1 month ago
runner.sh
Safe
952 Bytes
feat(runner.sh): using MODEL_ID only
about 1 month ago