`pointerpress`/`pointerrelease` event should be fired if only left mouse button is pressed

fixes #607 

backport #616 onto v3