Model Tag vllm is confusing as it refers to serving with vllm package not model type
Hi there,I noticed the tag „vllm“ on models recently and think it might lead to some confusion, as the tag „apparently“ serves to highlight models that can be served using the vllm package (as in „virtual LLM“, I guess).However this takes away the functional aspect of the model, ie as a „visual LLM“ that can take images or video as input and reason about those input types.While there‘s a clear task-tag around for both types, maybe a serving-type tag would be beneficial (besides vllm ollama comes to mind)? Let me know what you think.Best,MExamples:Task-Text-gen, vllm tag:neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8 · Hugging FaceNo-task-tag but vllm tag:mistralai/Pixtral-12B-2409 · Hugging FaceTask-img-Text-gen (+ multimodal, probably the best way w/o a extra serving-tag around):Qwen/Qwen2-VL-7B-Instruct · Hugging Face
2024-09-16T21:38:56Z
Unless the model author is an HF enthusiast more than he is an author, none of the users are familiar with the HF tag specifications. Based on inadequate official explanations, it is safe to say that the practice is to imitate others and set them up by hand.Just as HF is looking for users’ opinions. Please try to contribute.Of those requested, if the changes are easy for HF, some have already been realized!huggingface.co@victor on Hugging Face: "🙋 Calling all Hugging Face users! We want to hear...We’re on a journey to advance and democratize artificial intelligence through open source and open science.