⚡ WebGPU Benchmark Results (17.82x speedup)

#68
by hans00 - opened
Batch SizeWASM (fp16)WASM (fp32)WebGPU (fp32)
1461.80456.1058.40
2968.50916.30106.60
42025.001744.30161.50
84272.703778.40286.60
168781.408083.00525.30
3217967.2015692.501008.20
  • Model: Xenova/all-MiniLM-L6-v2
  • Tests run: WASM (fp16), WASM (fp32), WebGPU (fp32)
  • Sequence length: 512
  • Browser: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36
  • GPU: vendor=amd, architecture=gcn-5, device=, description=

Sign up or log in to comment