Good question. You need to carefully read the easement that you are writing about. If the fence that you wish to build does not interfere with the easement, you as the owner of your land should be entitled to build the fence.Before you build the fence, I would place the owner of the easement on notice about your intent after you consult with a real estate attorney about it.