Fix ViewList remove function to remove all views we've cached