Don't add empty lists of channel permissions to the JSON