Don't record group affiliation in activity action if group is hidden

Fixes #397