Only decompose matrix if there are bounds to be reused.