Barbara Baker, his first serious girlfriend, has said he informed her of his father's death without emotion and that he never spoke of his brother