Yes, it is recommended to sand the wood surface after caulk removal to smoothen out any imperfections and create a better surface for resealing or painting.