buildbot: remove only stuff we want to rebuild