Fixed view and proj matrices going out of sync