ENH: Speed up field computation matrix calculation