Remove host network interfaces when networks are destroyed.