Unsubscribe errors reject the message and are not fatal

Change-Id: Ia4177b1d3afee60c6e521ba2d2c6edb404c6c5e0