Join skeleton: remove IST group handling

Because annotations will replace also groups, no special handling for special
groups is needed anymore.