Most DMs would rule yes, you could remove the rust in a similar fashion to how you might clean a rusted item. However, Prestidigitation will not repair the damage caused, such as pitting caused by the rust.