Fixes #6117 - clean usergroup cache

Dependent destroy was missing on through association from user side.