This iterates through all alerts but does not iterate through all metrics, resulting in some barf. I think it should optionally do a single metric and break the loop; otherwise, it should do a `keys *` query in Redis to get all metrics matching an alert and run the test on all of them.