Fix constant recomputation of preview pipe

This might be a little dirty by just decreasing the chance of the
race condition to hit us. Not sure if proper locking would work though,
see comment in commit.