Always set remove timeout after hide