Remove build directories added by Brandon.