Call response error back instead of throwing them

An example when this is thrown is #95.