On the Groups>Groups/Capabilities screens allow to delete multiple groups/capabilities as bulk action.