You can not refuse to sell a home to some one based upon anything that could be seen as discriminatory. So you can refuse an offer from your neighbor as long as it is not based upon a recognized discriminatory ground: race, religion, sexual orientation, etc.  I would speak with a real estate attorney on this matter and give him or her the specifics.  Good luck.