Allow filtering by ToOneField when not only hashkey is the same