Adding all the remaining lattice points to lattice array