This should be in an ensure block since we're expecting exceptions.