Fixed #23329 -- Allowed to_field references from non-registered parent models.

Thanks to Trac alias Markush2010 for the detailed report.