Make sure the playing notification is only shown when playing is
actually started.