just run "grunt benchmark"

yes it should. also, the version on npm evidently does not support json output, so gotta point at the repo tarball instead.