If you're the courteous type and enjoy getting along with your neighbours, it would be generous to show the smooth side of the fence towards them, but this is far from being an established convention and there's absolutely no obligation to do so if you don't want to.