You can rinse the capers, but it isn't necessary. If you do rinse them, keep in mind that will rinse off some of the salty flavor added by the brine.