Knowing how many pairs of pants you should own is a matter of preference. On average, you should have five to six pairs of pants to cover different occasions like work, casual, and fitness.