because if you took them into your home to to work in your yard or whatever they'd know where your house is and how to break in then
Taking them to your home will let them know where you live.