He would not go without her.
The man refused to leave without her.