Remove old bootstrap directory