I am throwing this out there as a possibility.  It solves a lot of the performance impact off the bat, and I, personal opinion here, think it is a fair assumption that people would not be loading Glimpse plugins in the GAC.