Fixed broken auth caching for Swift

* A set() call was missing since 2af7ad8

Change-Id: I62b277e886c7ce6142a4d20f705b8337c3e4be58