Remember import directories even if import fails.