Only load colors when LiteDFM is inactive

This resolves the improper restoration of colors in the case of someone
running LiteDFM twice before running LiteDFMClose.