Fix group member permission check

User's permissions in one group were affecting things owned by groups
the user didn't belong to.