Remove upgrades that happen in ipython/base