Two common brands are the Ketch-All and the Tin Cat . I prefer the latter because it is smaller and will fit in places the other would not fit. I have caught as many as 9 mice in one Tin Cat baited with oatmeal. Tin Cats are not available in stores, but you should be able to find them online. If they don't carry them, they will be able to get them for you or point you in the right direction.
Mice eat a variety of foods, including fruits and vegetables.
As a matter of fact, they will eat almost anything edible, including each other. Releasing the mice where they will no longer be a problem is a good idea. There is no reason to kill them or anything else if there are alternatives such as capture and release.