VideoCommon: Custom texture handling

This won't change the custom texture format neither any compatibility. It's just a cleanup to let us change this more easily.
This also seperates the texcache hash from the custom texture hash. Now both can be calculated independet. Through we do hash twice on texcache miss and enabled custom textures.