This can be perfectly safe. However, it is a lot more work, and you have to do more vetting on your own than if you use a broker. The risk is about the same as hiring a moving company yourself, but you won't get any of the additional insurance offered by most brokers.