Fix shift+click being able to toggle left click actions, and vice versa