text
I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! 🤯 Since everything runs 100% locally, no messages are sent to a server — a huge win for privacy!
I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! 🤯 Since everything runs 100% locally, no messages are sent to a server — a huge win for privacy!
new_line
text
- 🤗 Demo: 
- 🤗 Demo: 
resource
https://huggingface.co/spaces/webml-community/phi-3.5-webgpu
space
webml-community/phi-3.5-webgpu
https://huggingface.co/spaces/webml-community/phi-3.5-webgpu
new_line
text
- 🧑‍💻 Source code: 
- 🧑‍💻 Source code: 
link
https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! 🤯 Since everything runs 100% locally, no messages are sent to a server — a huge win for privacy!
- 🤗 Demo: https://huggingface.co/spaces/webml-community/phi-3.5-webgpu
- 🧑‍💻 Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
🔥
cschroeder DmitryRyumin John6666 4rtemi5 DenyTranDFW Rybens YaTharThShaRma999 massimoavvisati Bruhn nguyenbh DiamanteAmarelo TheDrunkenSnail not-lain cfahlgren1 loubnabnl Ramikan-BR Omarito2412 revolunet osanseviero jweston cahlen captainspock louisbrulenaudet rmanoj ethix RojoXlon jundialwan ghosty-0 chrislhow gianpaj parksthecoder
🚀
jdspugh DiamanteAmarelo cfahlgren1 Ramikan-BR GordonM cahlen
😔
ZeroWw cahlen
❤️
Ramikan-BR cahlen
👀
Ramikan-BR cahlen
🤯
ayouba
/avatars/54483699273ac58a4a6fe1fa4aab65fe.svg
Robert Sinclair
ZeroWw
user
https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/RA-UgDNTPsF6j5uDnG3-N.jpeg
Akarshan Biswas
qnixsynapse
user
/avatars/4b954dcff7739057e105c6e9019d7ca2.svg
Nicki Gataro
ceoofcapybaras
user
/avatars/866bd569f610f81a33ecf0d2077213bd.svg
Ras
Ke09876
user
/avatars/a996119e73a87724100e82babffe70ad.svg
Jon Schlinkert
jonschlinkert
user
/avatars/c8891564e64052c3af1c07d11e7d74bf.svg
Nomi
Agroni
user
/avatars/d9d2d692aef76c4131be177b693f109f.svg
Gianfranco Palumbo
gianpaj
user