After using coffee grounds to scrub your hands, they should be disposed of. The grounds will have absorbed the fishy smell and won't be good for another use.