From Texts to Networks: Detecting and Managing the Impact of Methodological Choices for Extracting Network Data from Text Data
This thesis (Diesner in Technical Report CMU-ISR-12-101, 2012) addresses a series of methodological problems related to extracting information on socio-technical networks from natural language text data. Theories and models from the social sciences are leveraged and combined with computational approaches to (a)construct, analyze and compare network data and (b)combine text data and network data for analysis. This thesis entails various projects that serve three purposes: First, the impact of various common coding choices, including reference resolution and co-occurrence-based link formation, on network data and analysis results is empirically identified across multiple types of text data and domains. Second, different relation extraction methods are compared across various over-time, open-source, large-scale datasets with respect to the resulting network data and analysis results. This study offers a complement to traditional strategies for accuracy assessment. The relation extraction methods considered include network data construction based on (a)manually versus automatically built thesauri, (b)meta-data, and (c)collaboration with subject matter experts. Third, the concepts of grouping and roles from network analysis are integrated with text mining methods to enable the theoretically grounded, joint consideration of text data and network data for real-world applications.
socio-technical networks reference resolution relation extraction semantic networks entity extraction network clustering