Fix NPE when checking server version

Set and unset the swipe refresh listener when fragment starts/stops

Change-Id: I5c5cb4acb7c0d94627a6fd4ce9e2fd3df620cecf