Check for nonfinite numbers in abs2(::Complex)

abs2 now follows the behavior of abs in allowing Inf to dominate NaN. Ref: #5979