The house they sought was some way down.
The place of residence they were looking for was some way down.