Check local ordinances and talk with those on the 'other side' to be sure. As the old saying goes, "Good fences make good neighbors."