Remove the extra complexity of holding a HtmlElement attribute in the PointerInfo.