It is strange that simply hiding doesn't work. But setting it to invisible before removing it seems overkill :)