Remove watchers from people who have access