Delete old aliases before creating a new one