He said he informed the White House Friday of the decision to withdraw after uncovering tax and immigration problems related to a woman who was his family 's housekeeper and nanny .