backend: Avoid the spinner staying on the video

When doing normal buffering, it was possible to start playback
without the buffer being full, so the spinner never went away.