Clear the modules only if we are loading a conf