If you mean that I was fond of her, yes, I was. 
I can't say I've ever been fond of her. 
mnli hypothesis: I can't say I've ever been fond of her.  premise: If you mean that I was fond of her, yes, I was. 