Model: clearing async diffcheck on destroy

This avoids synchronous destroys before the async diff check which will
then compare against invalid objects.