If the plant sits too high in the pot, you'll have to lift the plant out, dig some soil out, or just dump the pot out and start over. Some folks like to put stuff like gravel or charcoal in the bottom of their pots. The plant will be better off without it since more of a good soil mix will be available for the roots to grow into. Stuffers like to press in the soil around a newly potted plant. Fillers like the plant to fill the pot to the rim and let the soil settle in with the first few waterings.
Most people just seem to be one or the other.
I happen to be a filler most of the time. I do find it necessary to stuff a bit at times, especially for top-heavy plants that need to be steadied in place. Large specimen plants are obviously a bit harder to work with. Because of their size and weight, it may not be possible to turn the plant over and knock the plant out of its pot. Plants with a strong root ball that are growing in large flexible plastic pots can be laid on their sides and rolled over.