There are three main reason why I do this:
It helps to keep the paper flat while painting.
A white border around looks nice and neat when a painting is finished.
The white border can be used to attach the painting to the back of a passe-partout (mat board, with the center cut out) and that will finish it off nicely before framing.