His wife and children had always argued that Brossard , a former escort with whom he had had a tempestuous four-year affair , was a money-grabbing murderer who had killed her lover when he threatened to take back a gift of $ 1m ( £ 612,000 ) , which she had requested " as proof of his love . "