extract pointer input from gui system