Is this something you might want to set on a per-test basis?  I can imagine setting different baselines for each backend so you can provide more accurate upper-bounds.