Revert "[WIP] fix retrieval of group members and cache group members"

Reverts owncloud/core#11161 which I wrongly merged when believing it was ready.