Don't do fancy matrix math unless it is necessary