While you could store the touch ids from the touchstart, the problem is keeping them around and not have them be overridden and all that other fun stuff.
Touch rejection is hard.