Changed the map movement code to be left click only. Selection happens as expected.