It’s a good idea to sand in between coats of polyurethane, but you need to ensure that the paint is completely dry and dust-free. Sand the surface lightly, vacuum it and then wipe it down using a lint-free cloth to eliminate sanding dust.