sort portal layers so they're above links/fields - but only when there's not that many
a lot of redrawing occurs when sorting portals - so only ordering when there's a low number keeps things reasonably fast