If you are next to someone it causes you harm, it is better to walk away. You cannot afford to be with someone who does not treat you well and only adds suffering to your life.