We could but the plugins would have to be loaded dynamically (to change the isolation accordingly) per plugin. As an alternative we could just randomly switch the global isolation flag - which means loading all the plugins either in isolation or in the same CL.
I'm not sure how many plugins we actually have to hammer this out however I'm adding some randomness to it will stress test it further (which is good!).