No, those edges count as free fences. You would only need one fence on the other side (add have all the houses filled) to complete the neighborhood. If it is not a dotted white line, you do not need a fence there.