Don't assume relation.modelTo in case of polymorphic belongsTo

Fixes #446