Ensure we correctly disconnect from sizeChanged signal.

Disconnect earlier, or m_item will already be 0 and the
disconnect will not be done.