Remove fence device from fencing levels on delete