Tom Skinner, Top Man of the Lords