Unsubscribe from watched builders during stop so reconfigure works

This is a pull request for http://trac.buildbot.net/ticket/2489.