Anything you can think of to keep from calling "comment_sources_get_source_node" for every node viewed on a site that has never had any comments enabled for a type?  Maybe nothing in the comment_sources module but have the vsite module keep track of if a site has ever had comments and "disable" this hook if it has not to remove the extra logic....?