Perhaps had her husband been a stronger personality, particularly had he been able to match her intellectual abilities, some of the problems might have been avoided, for it was Lady Byron who dominated the whole family. However around 1850 Lovelace fell out with her mother, almost certainly when she discovered that for years her mother had lied to her about her father Lord Byron. Lady Byron had tried all her life to make sure her daughter was as different from Lord Byron as possible and eventually Lovelace discovered the extent of her mother's manipulation.
Marahil ay ang kanyang asawa ay isang malakas na pagkatao, lalo na siya had been able sa tumugma sa kanyang intelektwal na kakayahan, ang ilan sa mga problema ay maaring iwasan, para sa mga ito ay Ina Byron na dominado ng buong pamilya. Subalit sa paligid 1850 Lovelace Nahulog out sa kanyang ina, halos tiyak kapag siya natuklasan na taon para sa kanyang ina had lied sa kanyang tungkol sa kanyang ama Panginoon Byron. Ina Byron may tried lahat ng kanyang buhay upang tiyakin na ang kanyang anak na babae ay bilang mula sa iba't-ibang Panginoon Byron hangga't maaari at sa huli Lovelace natuklasan ang lawak ng kanyang ina ng manipulasyon.