Only exile the player if the plugin is configured to allow exiles