⚡ WebGPU Benchmark Results (130.75x speedup)
#23
by
pcuenq
HF staff
- opened
| Batch Size | WASM (ms) | WebGPU (ms) |
| 64 | 17984.10 | 310.40 |
- Model: Xenova/all-MiniLM-L6-v2
- Quantized: false
- Sequence length: 512
- Browser: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36
- GPU: vendor=amd, architecture=rdna-1, device=, description=
Cheating: opening Developer Tools slows down WASM, running Chrome with no bounds checking in the Dawn (WebGPU) implementation 😈