Add randomized plugin isolation to test infrastructure

fix #5296