Yet he had a certain charm of manner, and I fancied that, if one really knew him well, one could have a deep affection for him. 
Nobody liked him because he was weird
mnli hypothesis: Nobody liked him because he was weird premise: Yet he had a certain charm of manner, and I fancied that, if one really knew him well, one could have a deep affection for him. 