The sanding process tends to leave behind a lot of small wood particles, and these wood particles can stop things like paint and varnish from adhering to the surface, or they could ruin your finish entirely.