To remove rust stains from vinyl siding, you can purchase a cleaning solution and gently clean the siding.