Allow removal of groups with existing access policy rule

Bug: 1085703
Change-Id: I9984a13594866ccb19ade9a0a2e6b8d88a8003f9