Fix mass deletion quirks, including test failing due to unicode issues.

Should we? If JSON parsing fails, I'm not sure how much I care why it fails. I don't mind limiting it to `ValueError`, though.