Actually, really don't leave the visted house

Whoops, turns out I forgot a crucial argument. It's all good now, I
tested it by having everyone pile in to the same house. Was awesome, you
should have been there.