As a general rule, you should plan to use ½ pound of potatoes per person. So, for example, if you are planning on 10 people, use 5 pounds of potatoes, or for 4 people, use 2 pounds of potatoes.