Item12471: Fix test of 3-argument open

Also make sure that an "insane" system is reported to the user
immediately.

Minor Tidy change also applied.

git-svn-id: http://svn.foswiki.org/branches/Release01x01/core@16653 0b4bb1d4-4e5a-0410-9cc4-b2b747904278