The process server can wait outside for you to leave your residence and serve you with the documents.  This is not harassment.  It is a common practice for process servers to do a stake-out in order to serve people with the documents.  A person can be served at any location.  It does not have to occur at your residence.