Running
6
🚀
Ci Splunk PRO
Csplk
AI & ML interests
None yet
Recent Activity
liked
a Space
2 days ago
Akshayram1/smol_agent
liked
a Space
2 days ago
VIDraft/ChemGenesis
liked
a Space
2 days ago
asahi417/controlnet-stable-diffusion-2-depth
Organizations
Csplk's activity
liked
4
Spaces
2 days ago
upvoted
a
paper
2 days ago
liked
a
Space
2 days ago
liked
2
Spaces
3 days ago
reacted to
hlarcher's
post with 🔥
3 days ago
Post
1004
We are introducing multi-backend support in Hugging Face Text Generation Inference!
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
liked
2
Spaces
3 days ago
liked
2
Spaces
4 days ago
liked
a
dataset
5 days ago
upvoted
a
collection
5 days ago
updated
a
Space
6 days ago
liked
a
model
6 days ago
liked
a
Space
6 days ago
liked
a
model
7 days ago
liked
a
Space
7 days ago