Yes, to do this you can go into the group, then press ‘more’ > ‘contact information’ and select ‘only visible for administrators’. This is a per-group setting, so you can hide your contact information in some groups while still sharing it with members in other groups.