Naturally, said Sir James dryly.

Does it follow that "Sir James spoke in a dry manner and that was his most endearing quality."?
it is not possible to tell