Handle category exclusions

Currently only globally for all agents.