Remove failed build directories