Don't relayout if widget itself is disposed, as invalidate children layouts happen on destruction, too