text
SemanticFinder now supports WebGPU thanks to 
SemanticFinder now supports WebGPU thanks to 
mention
@Xenova
Xenova
text
's efforts with transformers.js v3!
's efforts with transformers.js v3!
new_line
text
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
new_line
text
- WebGPU: 
- WebGPU: 
link
https://do-me.github.io/SemanticFinder/webgpu/
https://do-me.github.io/SemanticFinder/webgpu/
new_line
text
- Wasm: 
- Wasm: 
link
https://do-me.github.io/SemanticFinder/
https://do-me.github.io/SemanticFinder/
new_line
new_line
text
WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: 
WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: 
resource
https://huggingface.co/spaces/Xenova/webgpu-embedding-benchmark
space
Xenova/webgpu-embedding-benchmark
https://huggingface.co/spaces/Xenova/webgpu-embedding-benchmark
new_line
text
Chrome currently works out of the box, Firefox requires some tweaking.
Chrome currently works out of the box, Firefox requires some tweaking.
new_line
new_line
text
WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: 
WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: 
resource
https://huggingface.co/datasets/do-me/SemanticFinder
dataset
do-me/SemanticFinder
https://huggingface.co/datasets/do-me/SemanticFinder
new_line
text
Happy to hear your ideas!
Happy to hear your ideas!
SemanticFinder now supports WebGPU thanks to @Xenova's efforts with transformers.js v3!
Expect massive performance gains. Inferenced a whole book with 46k chunks in <5min. If your device doesn't support #WebGPU use the classic Wasm-based version:
- WebGPU: https://do-me.github.io/SemanticFinder/webgpu/
- Wasm: https://do-me.github.io/SemanticFinder/

WebGPU harnesses the full power of your hardware, no longer being restricted to just the CPU. The speedup is significant (4-60x) for all kinds of devices: consumer-grade laptops, heavy Nvidia GPU setups or Apple Silicon. Measure the difference for your device here: https://huggingface.co/spaces/Xenova/webgpu-embedding-benchmark
Chrome currently works out of the box, Firefox requires some tweaking.

WebGPU + transformers.js allows to build amazing applications and make them accessible to everyone. E.g. SemanticFinder could become a simple GUI for populating your (vector) DB of choice. See the pre-indexed community texts here: https://huggingface.co/datasets/do-me/SemanticFinder
Happy to hear your ideas!
🚀
TroglodyteDerivations osanseviero Felladrin maywell Xenova ngxson ai-everyday louisbrulenaudet adorkin
👀
John6666 Presidentlin Xenova ngxson
https://cdn-avatars.huggingface.co/v1/production/uploads/1674191139776-noauth.png
Xuan Son NGUYEN
ngxson
user