Yes, you can use sandpaper to remove wood glue that has formed large bumps and flatten them out. If you have already removed the wood glue, then you can use sandpaper to make the surface smoother.