Updated re-review queue to use ES (bug 1086688)

could probably just rename qs to apps