Allow deletion saves to error

Fixes #1113.