text
Following up on 
Following up on 
mention
@vikhyatk
vikhyatk
text
's Moondream2 update and 
's Moondream2 update and 
mention
@santiagomed
santiagomed
text
's implementation on Candle, I quickly put togheter the WASM module so that you could try running the ~1.5GB quantized model in the browser. Perhaps the next step is to rewrite it using 
's implementation on Candle, I quickly put togheter the WASM module so that you could try running the ~1.5GB quantized model in the browser. Perhaps the next step is to rewrite it using 
link
https://github.com/huggingface/ratchet
https://github.com/huggingface/ratchet
text
 and run it even faster with WebGPU, 
 and run it even faster with WebGPU, 
mention
@FL33TW00D-HF
FL33TW00D-HF
text
.
.
new_line
new_line
resource
https://huggingface.co/spaces/radames/Candle-Moondream-2
space
radames/Candle-Moondream-2
https://huggingface.co/spaces/radames/Candle-Moondream-2
new_line
new_line
text
ps: I have a collection of all Candle WASM demos here 
ps: I have a collection of all Candle WASM demos here 
resource
https://huggingface.co/collections/radames/candle-wasm-examples-650898dee13ff96230ce3e1f
collection
radames/candle-wasm-examples-650898dee13ff96230ce3e1f
https://huggingface.co/collections/radames/candle-wasm-examples-650898dee13ff96230ce3e1f
Following up on @vikhyatk's Moondream2 update and @santiagomed's implementation on Candle, I quickly put togheter the WASM module so that you could try running the ~1.5GB quantized model in the browser. Perhaps the next step is to rewrite it using https://github.com/huggingface/ratchet and run it even faster with WebGPU, @FL33TW00D-HF.

https://huggingface.co/spaces/radames/Candle-Moondream-2

ps: I have a collection of all Candle WASM demos here https://huggingface.co/collections/radames/candle-wasm-examples-650898dee13ff96230ce3e1f
❤️
vikhyatk FL33TW00D-HF samusenps nikgr clem merve Felladrin osanseviero
🔥
vikhyatk FL33TW00D-HF clem merve kylen osanseviero