Revert "load package Matrix only when necessary and move it to suggests"

This reverts commit 944b02af9ece682fd647f62214f530989623452d.