Try to avoid re-activated the same conda-env twice

We want to avoid re-activations because Conda is slow.  For some reason.