The order in which you apply sand and sealer definitely matters. You must apply the sand first, sweeping carefully into the joints, ensuring none is left on the surface. Once the sealer is applied, it will trap anything that is left on the surface of the pavers. Make sure the joint sand is dry before sealing.