If someone were to build a shed, barn or other structure on his or her property without a building permit, the person could get slapped with a fine for not going through the proper channels. Also, if the shed is too close to a property line, the person may have to take down the shed and start all over again.