If the right of way is 100% on your property, you can do this: his right would be a right of access, but not a right to determine or restrict what you can put on your property (e.g. fence, sign, etc.). So long as you do not actually impede access, you can do this.