Colorbar doesn't have a remove method.  As far as I know, the only way to remove a colorbar currently is to call ```fig.delaxes(cb.ax)``` (which leads to the original issue (#2688)).