⚡ WebGPU Benchmark Results (15.53x speedup)

#67
by Akmittal - opened
Batch SizeWASM (fp16)WebGPU (fp16)
1964.00135.00
24445.00307.00
43899.00401.00
88011.00722.00
1617156.001199.00
3234390.002214.00
  • Model: Xenova/all-MiniLM-L6-v2
  • Tests run: WASM (fp16), WebGPU (fp16)
  • Sequence length: 512
  • Browser: Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Mobile Safari/537.36
  • GPU: vendor=arm, architecture=valhall, device=, description=

Sign up or log in to comment