Only allow the selection to be moved where it can be placed via a click