Expand test suite for triangular matrices and adjust triangular code accordingly.
Merge pull request #8719 from JuliaLang/anj/triangular

Expand test suite for triangular matrices and adjust triangular code accordingly.