According to her diary, she enjoyed Albert's company from the beginning