This could be happening as a result of the potatoes. Potatoes hold a lot of water, so if you do not drain them after boiling and let them sit for a few minutes before mashing them, the potatoes may release water after being mixed with the other ingredients resulting in watery potato salad.