Fix pjdfstest on 11-CURRENT with UFS

Change the memory disk size to 512kB to newfs failures in select cases

Also, die quickly on mount failures

Sponsored-by: EMC / Isilon
Submitted-by: Casey Peel @ isilon.com