Fail debug build if deleting the debug directory fails

Fixes #176