Only unmerge users made by the LDAP import (the system user)

This allows users to hand-merge additional addresses