Even if it does have a considerable performance impact, I think dropping this hack early is the only way we can come up with a good design as a base for a nonhacky optimization akin to texcache-rewrite.