Keep track of loaded classes when we load them somewhere else

Previously, a class could only be loaded in one single module.
Now, we can load them more than once, but they will all be the same.