Clean up build/ and cache/ if they did not exist initially