Fixes #6065 - Update TopbarSweeper to clear cache for other users than User.current

I'm unclear how to test this, does anyone have any ideas? I don't see any existing tests for TopbarSweeper...
Right, I think it's cleaner as we already have the sweeper object.