Do not build the internal cache automatically (see #5307)