Users should consider the grit of the sandpaper based on the task requirements, such as coarse, fine, or medium grit, to achieve the desired sanding, polishing, or material removal results effectively.