The hand with which he raised his glass to his lips shook slightly, but his eyes held Sir James's defiantly.
His hands were steady, but he could not meet Sir James' gaze. 
mnli hypothesis: His hands were steady, but he could not meet Sir James' gaze.  premise: The hand with which he raised his glass to his lips shook slightly, but his eyes held Sir James's defiantly.