He famously removed a photograph of Baruch Goldstein - an Israeli-American who gunned down 29 Palestinians in a mosque in 1994 - from his living room wall before entering politics.