Also rmtree on RuntimeError

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>