Fix potential lockup in connection groups

Fixes #124