Fixes possible crash in view manager

~View needs to remove any children. If it doesn't the children still
refer to the parent and may attempt to use it.

BUG=434555
TEST=later
R=erg@chromium.org

Review URL: https://codereview.chromium.org/739333002