Default to test mode membership off

* Fix all test cases in both modes
* Fix test case breakage caused by console rest api changes