qa_filters: Use retry in more cases

Even starting a (delay 0.01) job without filters does not happen
within the 0.5 seconds we allowed if run in a big cluster.
Use retry here as well.

Signed-off-by: Niklas Hambuechen <niklash@google.com>