Removing queued builds from the queue when the builder for that build has been removed

Should work on both reconfig and startup of buildbot