Fix floated window loses focus.

Can't call commands in layout remove as this is called whether the
layout has focus or not.