You can not break the lease unless either the court allows it or you and the landlord agree.  And he can not restrict you from having guests.  So maybe a discussion with him as to the matter is what you need to have.  Tell him that you have a right to guests under the law and he can not restrict family.  And that he can not make allegations of illegal activity against you that are baseless under the law.  It is your iintent to have your family over and if that is a problem maybe you should agree to terminate the lease early with out any repercussions to you.  Make sure you have a written agreement to terminate signed by both of you and that you do a walk through and you do not lose your security.  Having a lawyer look at it is always a good idea.  Good luck.