I'm not sure how bad it would be if User B, who is following User A, would see that User A has added a user to a group that can be seen by User B. However, no action required here yet.