Keep track of when models are requested/returned.

This will allow us to be more selective and make only unused models available for garbage collection.