You generally do not need a permit to put a fence around your yard in Smithtown, provided that the fence meets town regulations. You do need a permit for any fence over four feet high.