God wants you to stay away from someone when they do not allow you to do what is of God. Also, it is said in the bible that thou shall not commit adultery. This is a clear sign to stay away.