Allow empty list in add/remove srg members