This time the visitor was neither Whittington nor Boris, but a man of striking appearance.
Whittington and Boris are both ugly men compared to the new visitor. 
mnli hypothesis: Whittington and Boris are both ugly men compared to the new visitor.  premise: This time the visitor was neither Whittington nor Boris, but a man of striking appearance.