Run background jobs so cache updates. Behaviour was changed in aae92bd

Not sure we need this test any more since the behaviour between Rails
and PHP is different.

Fixes #221