Remove connection from ConnectionManager unconditionally on invalid proxy