# Text-mining tools for extracting information about microbial biodiversity in food

Estelle Chaix, Louise Deleger, Robert Bossy, Claire Nédellec

<figure><img src="image_1.png" /></figure>

## To cite this version:

Estelle Chaix, Louise Deleger, Robert Bossy, Claire Nédellec. Text-mining tools for extracting information about microbial biodiversity in food. Food Microbiology, 2019, 81, pp.63-75. 10.1016/j.fm.2018.04.011. hal-02628265

HAL Id: hal-02628265

https://hal.inrae.fr/hal-02628265

Submitted on 26 May 2020

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_3.png" /></figure>

ELSEVIER

Contents lists available at ScienceDirect

Food Microbiology

journal homepage: www.elsevier.com/locate/fm

<figure><img src="image_4.png" /></figure>

Food Microbiology

<figure><img src="image_5.png" /></figure>

# Text mining tools for extracting information about microbial biodiversity in food

<figure><img src="image_6.png" /></figure>

Check for
updates

Estelle Chaix*, Louise Deléger, Robert Bossy, Claire Nédellec**

MalAGE, INRA, Université Paris-Saclay, 78350 Jouy-en-Josas, France

## ARTICLE INFO

**Article history:**

Received 8 November 2017

Received in revised form

26 March 2018

Accepted 17 April 2018

Available online 21 April 2018

**Keywords:**

Microbial biodiversity

Text mining

Information extraction

Food spoilage

## ABSTRACT

Information on food microbial diversity is scattered across millions of scientific papers. Researchers need tools to assist their bibliographic search in such large collections. Text mining and knowledge engineering methods are useful to automatically and efficiently find relevant information in Life Science. This work describes how the Alvis text mining platform has been applied to a large collection of PubMed abstracts of scientific papers in the food microbiology domain. The information targeted by our work is microorganisms, their habitats and phenotypes. Two knowledge resources, the NCBI taxonomy and the OntoBiotope ontology were used to detect this information in texts. The result of the text mining process was indexed and is presented through the AlvisIR Food on-line semantic search engine. In this paper, we also show through two illustrative examples the great potential of this new tool to assist in studies on ecological diversity and the origin of microbial presence in food.

© 2018 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license

(http://creativecommons.org/licenses/by/4.0/).

## 1. Introduction

Food ecosystems are constrained by intrinsic factors (e.g. pH, salinity, water activity) and extrinsic factors (e.g. temperature, gas concentration or conservation process) (Doyle and Buchanan, 2012). There are more and more scientific studies that analyze, describe and explain microbial diversity in samples from specific food products with respect to these factors. Indeed, the generalization of omics technologies and analytical methods allows an easier exploration of different flora across similar food products. In particular, DNA-based technologies, such as high-throughput sequencing technologies, produce a large amount of information about microorganism species and strains identified from different environments (Bokulich et al., 2016).

It is now possible to study in depth the microbial composition of the flora, as well as the interactions that microorganisms develop with their environment and among themselves to identify major trends in food products. More generally, the production of biological data on microflora is increasingly easy. However collecting published information remains time-consuming, although it is

highly valuable for the interpretation of experiments and for the design of further experiments. For instance, significant correlations between microbial species and their respective habitats and phenotypes are impossible to explore at a large scale. Scientific review papers are useful sources of information as they summarize the current state of knowledge on the microbial flora of given food products (e.g. microbiota in cheeses (Montel et al., 2014) or in raw meat (Doulgeraki et al., 2012)) and on the different types of food where a given organism is found (e.g. *Listeria monocytogenes* in European cheeses (Martinez-Rios and Dalgaard, 2018) or *Lactococcus piscium* in various food (Saraoui et al., 2016)). However, a collection of primary literature papers is highly difficult to summarize for three major reasons: the size of the corpus to be searched, the scattering of the information through several papers and databases (e.g. catalogs of collections of biological resource centers, sequence databases) and the lack of structure and standards shared between sources. New text mining and knowledge representation technologies that tackle these problems are emerging.

### 1.1. A large amount of scattered data

Fig. 1 illustrates the constant increase in publications related to food microbiology. The threshold of 1000 publications per year was exceeded in 1994, and there is a significant increase in publication number in 2005 (with more than 3000 articles per year). The

<footnote>* Corresponding author.</footnote>

<footnote>** Corresponding author.</footnote>

<footnote>E-mail addresses: estelle.chaix@inra.fr, estelle.chaix@gmail.com (E. Chaix), claire.nedellec@inra.fr (C. Nédellec).</footnote>
<figure><img src="image_7.png" /><figcaption>**Fig. 1.** Increasing rate of publications in PubMed between 1945 and 2015 on the subject of food microbiology. The light orange curve represents the cumulative number of documents (left-hand scale). The dark blue curve represents the number of documents published per year (right-hand scale). See Material and Methods for further details. (For interpretation of the references to colour in this figure legend, the reader is referred to the Web version of this article.)</figcaption></figure>

amount of publications and the development of microbial identification techniques are correlated: in the 1990s some phenotypic methods were already cheap and easy to use. In the 2000s the release of genotypic methods and routine materials such as Next Generation Sequencing machine by Roche, and the GA sequencer from Solexa had a high impact on the identification of organisms and the study of the biological mechanisms involved in their adaptation and interaction (Escobar-Zepeda et al., 2015). Since 2013, the number of publications per year tops out at 5500.

A large amount of information about isolation sites and phenotypes is also scattered across several databases. Table 1 lists some of the major databases used for referencing either habitat or microbial phenotype information.

## 1.2. Unstructured information and lack of standards

Textual information is expressed in unstructured, natural language form at different levels of precision which makes it difficult to find. We illustrate language variability of microbe habitats by two examples on publications about cheese microflora. The relationship between the microbe and the cheese it has been isolated from, is expressed by “Carnobacterium maltaromaticum CPN, a strain isolated from unpasteurized milk Camembert cheese” in Hammi et al. (2016) and by “Only *Y. enterocolitica* was found to grow on the surfaces (outer and exposed) of Brie at all three storage temperatures” in Little and Knøchel (1994). In these examples, the habitat “cheese”, and more precisely “mould ripened cheese”, is denoted by the two different expressions “unpasteurized milk Camembert cheese” and “Brie”. The common bibliographic search engines use keyword queries that are too limited for taking into account such variability. A keyword query such as cheese fails to retrieve all of the relevant information. For instance, they miss documents where the proper name of the cheese (“Brie”) is used instead of the term “cheese”. Queries that include all cheese names are impractical to build and maintain. Moreover, keyword queries

<table><caption>**Table 1**
Major databases with microbial habitat or phenotype information.</caption><thead><tr><td>Database name</td><td>Institution</td><td>Relevant information entries</td></tr></thead><tbody><tr><td>BacDive</td><td>DSMZ</td><td>24,150 "isolated from"</td></tr><tr><td>/</td><td>ATCC</td><td>18,000 "isolation"</td></tr><tr><td>GOLD</td><td>JGI</td><td>25,000 "isolation site"</td></tr><tr><td>GenBank</td><td>NCBI</td><td>60,000 "isolation source"</td></tr></tbody></table>

are not suitable for retrieving the relationships between the microorganisms and isolation samples.

Knowledge resources such as controlled vocabularies, taxonomies and ontologies, bring a partial answer to the limitations of keyword-based search engines. Knowledge-based search engines extend simple string-matching with queries on general terms that do not depend on how they are expressed in the text. PubMed bibliographical database indexing with the MeSH thesaurus is a representative example.

Knowledge resources, in particular structured representation such as ontologies, also answer to information dispersion in various sources by providing a shared reference representation (Kelso et al., 2010). For example, many different databases share the Gene Ontology (Ashburner et al., 2000) for indexing gene properties.

## 1.3. Text mining for bibliographical research

Knowledge resources alone are insufficient to capture all the language variations. Text mining technologies combine knowledge resources, linguistic analysis, and machine learning to deal with language variations. Furthermore text mining tools can extract terms from text, but also relationships between terms. Text mining tools and methods have been used to analyze publications in several domains, especially in the biomedical domain (see examples in the review of Fleuren and Alkema (2015)).

Fine-grained information extraction achieves high performances in Life Science (Kim et al., 2011). The need for text mining in the microbiological field was identified more than a decade ago (Bessières et al., 2006), which we confirmed with a recent needs analysis, targeting food microbiologists (Chaix et al., 2017). The pioneering work on EnvDB database (Pignatelli et al., 2009) aimed to link GenBank sequences of microbes to biotope mentions in scientific papers. However, EnvDB was affected by the incompleteness of the GenBank isolation source field, the low number of related bibliographic references, the limited results of the text mining extraction method and the small size of its habitat classification. The few text mining projects applied to microbiology focus on biomedical aspects of the field. For example, the study on document classification related to type IV secretion systems bacteria (Ananiadou et al., 2011), and the application on bacterial enteropathogens (Zaremba et al., 2009) (no longer on-line). Their focus is mainly on gene detection in pathogenic microbes. MicroPIE is an example of extraction of microbial phenotypes: the MicroPIE bioinformatics application uses text mining tools to classify sentences according to 42 microbial phenotypes (Mao et al., 2016).

More generally, information retrieval about microbes was boosted by the text mining competitions on gene regulation and biotopes (Bossy et al., 2011, 2015; Deléger et al., 2016). These competitions promoted the development of efficient tools to detect entities of interest and relationships in microbiology literature, without focusing on a particular biotope.

As far as we know, the food domain has never been targeted as such by text mining research despite the importance of the domain. This work proposes text mining tools along this line, to extract information relevant to the food microbiology domain from the scientific literature. The results are indexed by an ontology and can be queried by a semantic search engine intended for researchers in food microbiology.

# 2. Material and methods

## 2.1. Strategy and resources

In this section, we describe the text mining approach that we designed to extract information about food microbiology from
<table><caption>**Table 2**
MeSH terms and tree numbers used for the corpus selection.</caption><thead><tr><th>Microbe</th><th></th><th>Food domain</th><th></th></tr></thead><tbody><tr><td>Alveolata</td><td>B01.043</td><td>Diet, Food and Nutrition</td><td>G07.203</td></tr><tr><td>Amoebozoa</td><td>B01.046</td><td>Food Analysis</td><td>E05.362</td></tr><tr><td>Nematoda</td><td>B01.050.500.500.294</td><td></td><td>J01.576.423.850.100</td></tr><tr><td>Choanoflagellata</td><td>B01.175</td><td>Food and Beverages</td><td>J02</td></tr><tr><td>Cryptophyta</td><td>B01.206</td><td>Food Industry</td><td>J01.576.423</td></tr><tr><td>Diplomonadida</td><td>B01.237</td><td>Food Microbiology</td><td>H01.158.273.540.274.332</td></tr><tr><td>Euglenozoa</td><td>B01.268</td><td></td><td>N06.850.601.500.249.300</td></tr><tr><td>Fungi</td><td>B01.300</td><td></td><td>N06.850.425.200</td></tr><tr><td>Haptophyta</td><td>B01.400</td><td></td><td>N06.850.460.400.300</td></tr><tr><td>Mesomycetozoea</td><td>B01.500</td><td>Food Packaging</td><td>J01.576.423.200.375</td></tr><tr><td>Oxymonadida</td><td>B01.625</td><td></td><td>J01.576.423.850.600</td></tr><tr><td>Parabasalidea</td><td>B01.630</td><td></td><td>J01.576.761.400</td></tr><tr><td>Glaucophyta</td><td>B01.650.232</td><td>Food Quality</td><td>J01.576.423.850.730</td></tr><tr><td>Chlorella</td><td>B01.650.940.150.469</td><td></td><td>N06.850.601</td></tr><tr><td>Prototheca</td><td>B01.650.940.150.634</td><td></td><td></td></tr><tr><td>Volvocida</td><td>B01.650.940.150.925</td><td></td><td></td></tr><tr><td>Volvox</td><td>B01.650.940.150.950</td><td></td><td></td></tr><tr><td>Desmidiales</td><td>B01.650.940.800.150.200</td><td></td><td></td></tr><tr><td>Retortamonadidae</td><td>B01.675</td><td></td><td></td></tr><tr><td>Rhizaria</td><td>B01.680</td><td></td><td></td></tr><tr><td>Stramenopiles</td><td>B01.750</td><td></td><td></td></tr><tr><td>Crenarchaeota</td><td>B02.075</td><td></td><td></td></tr><tr><td>Euryarchaeota</td><td>B02.200</td><td></td><td></td></tr><tr><td>Korarchaeota</td><td>B02.500</td><td></td><td></td></tr><tr><td>Nanoarchaeota</td><td>B02.600</td><td></td><td></td></tr><tr><td>Bacteria</td><td>B03</td><td></td><td></td></tr><tr><td>Viruses</td><td>B04</td><td></td><td></td></tr></tbody></table>

scientific documents. Text mining applications usually consist of four components: (1) the text mining methods themselves; (2) the formal definition of the type of information to be extracted; (3) the collection of relevant documents, e.g. scientific articles (referred to as corpus); and (4) structured knowledge resources (such as taxonomies, dictionaries or ontologies) that contribute to the detection of textual information and its normalization. Normalization consists of assigning a same category from the knowledge source to similar pieces of text to make text mining results more easily used and interoperable with other applications. We detail each of these points in the following subsections.

## 2.2. Information to be extracted

Information extraction consists in recognizing specific pieces of information that have been pre-defined. These pieces of information include entities (i.e. terms that are of particular interest to a domain) and relationships between these entities.

We consider here three types of entity: microorganism taxa, habitats and phenotypes; and two relationships: the "Lives_in" relation between a microorganism and its habitat(s) and the "Exhibits" relation between a microorganism and its phenotype(s).

## 2.3. Corpus

To build a corpus of documents related to the food microbiology domain, we selected all publicly available abstracts through the PubMed services of the NCBI. The PubMed bibliographic database is not only a relevant source for this domain, but references are also available for text and data mining and they can be freely re-distributed and copied. This right is necessary for the display of the context of the extracted information to the user. We expressed PubMed queries with MeSH thesaurus keywords in order to identify relevant abstracts from both the microbe and food domains. Table 2 gives the MeSH terms that we identified as relevant to these two fields. Column 1 lists the main microscopic organism taxa. Column 2 lists PubMed main food topics, including processing and packaging.

The U.S National Library of Medicine (NLM) publishes a set of MEDLINE/PubMed citation records each year. We used the 2016 PubMed release to select relevant abstracts covering the period from 1945 to early 2016 as shown in Fig. 1. From this source, two corpora have been built: (1) the so-called *MicrobioPubmed* corpus, which is a selection of all abstracts indexed by Mesh terms related to microorganisms (2,333,943 abstracts); and (2) the so-called *Food* corpus, which is a sub-selection of the *MicrobioPubmed* corpus indexed by Mesh terms of the Food domain (101,072 abstracts).

We will update the two corpora with the next annual release at the end of 2017, and we will then update them periodically using daily updates provided by the NLM.<fnref n="1" />

## 2.4. Knowledge resources

In this work, we used two external knowledge resources, the NCBI taxonomy and the OntoBiotope ontology at two steps, first for the detection of the entities in the text by the text mining process and then for the indexing and retrieval of the entities by the end-users of the application. The resources have hierarchical structures so that the information retrieval queries can be expressed at different levels of generality depending on the needs, from the very specific (e.g. strain, given local specific cheese) to the very general (e.g. taxon order, food).

### 2.4.1. Taxonomy

We use the taxonomy of the NCBI<fnref n="2" /> to detect mentions of microorganisms in the documents and assign them a reference taxon. NCBI taxonomy keeps track of synonyms and renaming, which is useful information for old bibliography search. NCBI taxonomy is also used as a reference to describe organisms in many databases: NCBI databases such as Sequence Read Archive (SRA) or GenBank,

<footnote n="1">¹ For more information, see the NLM website www.nlm.nih.gov.</footnote>

<footnote n="2">² NCBI taxonomy: https://www.ncbi.nlm.nih.gov/taxonomy.</footnote>
but also in European Nucleotide Archive (EMBL-EBI) or DNA Data Bank of Japan (DDBJ) (Federhen et al., 2014). Using the same taxonomy to index textual and biological information will make cross-reference easier.

### 2.4.2. Ontologies

There have been very few attempts at microbial habitat standardization that yield either to very small and insufficient classifications, like the one of the American Type Culture Collection (ATCC) (Floyd et al., 2005) or the Genomes Online Database (GOLD) (Ivanova et al., 2010), to the notable exception of OntoBiotope ontology. We have developed the OntoBiotope ontology since 2010. It is publicly available on the Agroportal<fnref n="3" /> website, which is the major portal for ontologies in the agronomy domain. To our knowledge, it is the most complete resource on micro-organism habitats and phenotypes with 3,000 classes.

As an ontology, OntoBiotope represents domain knowledge in a formal, conceptualized and unified way (Gruber, 1993). The domain classes are formally defined and linked together by formal relations. The hierarchical relation links classes that are subtypes of each other. For instance, the three classes "kefir", "yogurt" and "sour milk" are subclasses of the larger class "fermented milk". This formally means that "Kefir is a fermented milk". It has proved useful for information extraction (Papazian et al., 2012) and Habitat entity categorization in text mining challenges (Bossy et al., 2015).

The Habitat branch, called "OntoBiotope Habitat" in the following, includes a subtree dedicated to food products. We built it by reusing the FoodEx classification of European Food Safety Authority (EFSA, 2015), which we complemented by knowledge of microbiology and food domain experts. We chose FoodEx because of its attention to microbiological issues, including hazard and processing. The current version of the Food subtree in OntoBiotope consists in 801 classes at seven levels. The main branches reflect microbiology food research topics. The "Commodity and primary derivative thereof" subtree classify ingredients according to their origin (e.g. meat, milk, seafood, egg, honey). The "Processed food" subtree classifies food in 16 classes, e.g. canned, cooked, frozen, fermented. A specific branch is dedicated to animal food.

In addition to microbial habitats, we extended OntoBiotope with a second major branch dedicated to microbial phenotype, called "OntoBiotope Phenotype" (Nédellec et al., 2017). It classifies microbial phenotypes according to stress adaptability, including energy source, community behavior, host interaction, morphology, motility, metabolism and response to external conditions such as temperature (*psychophile*), pressure (*piezotolerant*), acidity (*alkaliphile*), or salinity (*extreme halophile*). The current version of OntoBiotope Phenotype contains 323 classes. Since we started building OntoBiotope, other work on phenotype has been published. The OMP ontology (Ontology of Microbial Phenotypes) (Chibucos et al., 2014) could have been relevant, but some useful phenotypes are missing such as those relative to obligate conditions (e.g. "obligate piezophile"). Furthermore, it is not fully well-suited for text mining, because the labels of the classes are different from the vocabulary used in papers and databases (e.g. "mesophilic growth" for e.g. "mesophile").

### 2.5. Text mining methods

We used the Alvis text mining platform to design the information extraction pipeline (Ba and Bossy, 2016). The pipeline is composed of two steps: (1) entity recognition and normalization

and (2) relation extraction. The first step identifies relevant terms in text and normalizes them according to selected knowledge resources, i.e. entities are assigned a specific entry from a given taxonomy or ontology. Then, relation extraction establishes links between identified entities.

### 2.5.1. Detecting and normalizing entities

The Alvis pipeline extracts terms that denote microorganisms, habitats and phenotype entities using linguistic-based and rule-based text mining methods.

To detect mentions of microorganisms, it automatically finds matches between text strings and NCBI taxa (canonical names and synonyms). It applies rules to recognize variations of microorganism names, for example, the variants of e.g. "Helicobacter pylori": "H. pylori", "H pylori", "Hp". Recognized microorganism names are then assigned their NCBI TaxID.

For Habitat and Phenotype entity detection, we use a strategy that has shown to perform well in a similar task (Ratkovic et al., 2012). It involves a deeper linguistic analysis in two steps. First, the YaTeA term extractor extracts all terms, noun phrases and adjectival phrases from the text (Aubin and Hamon, 2006). Then, the ToMap method looks for matches between candidate terms and classes from the OntoBiotope ontology (Golik et al., 2011). Terms and class labels that have a similar internal syntactic structure are mapped and a similarity score is computed. ToMap then chooses the term-class pair with the highest similarity score. If a term cannot be mapped to a class then it is discarded, meaning that it is neither a habitat nor a phenotype. In addition to the core algorithm, dedicated heuristics handle ambiguous cases for the two types of entity, Habitat and Phenotype.

Entity recognition and normalization is illustrated by the examples of Fig. 2. The highlighted portions of the sentence represent the entities: "Contamined retail chicken meat" as habitat, "E. coli" as microorganism, and "multi drug resistant" and "MDR" as phenotypes. The three square boxes at the top represent the class these entities have been assigned. The boxes show identifiers and class names from the knowledge resources. The "Contamined retail chicken meat" habitat entity has been assigned the more general class "Chicken meat" from the OntoBiotope ontology. The "E. coli" microorganism has been linked to the NCBI taxon "Escherichia coli". Both phenotypes, "multi drug resistant" and "MDR", are synonyms and have been matched to the OntoBiotope class "Drug resistant".

### 2.5.2. Extracting relations

The relation extraction method links recognized entities based on their proximity in the text (i.e. they must be part of the same sentence) and on linguistic cues called "trigger words" (Ratkovic et al., 2012). Trigger words are textual expressions that indicate a relationship between two entities. For instance, the expression "isolated from" usually shows a relation between a microorganism and its habitat.

The method also includes an anaphora detection component that links specific microorganism mentions to their anaphoric expressions. Anaphora are used to refer to entities previously mentioned in the text without repeating their name. For instance, authors may not repeat the name of a microorganism in the sentence describing its habitats and use a pronoun (e.g., "it") or a more generic term (e.g., "this microorganism") instead.

Fig. 3 shows the relationships between the identified entities from the example of Fig. 2. The "E. coli" microorganism is linked to the "chicken meat habitat" (by the Lives_in relation) and to the "multi drug resistant" phenotype (Exhibits relation).

<footnote n="3">³ OntoBiotope in Agroportal: http://agroportal.lirmm.fr/ontologies/ONTOBIOTOPE.</footnote>
<figure><img src="image_8.png" /><figcaption>**Fig. 2.** Example sentence with microorganism, habitat and phenotype entities.</figcaption></figure>

<figure><img src="image_9.png" /><figcaption>**Fig. 3.** Example of relations between detected entities.</figcaption></figure>

<table><caption>**Table 3**
Descriptive statistics of text mining results.</caption><thead><tr><th></th><th>MicrobioPubmed corpus</th><th>Food corpus</th></tr></thead><tbody><tr><td><strong>Documents</strong></td><td><strong>2,333,943</strong></td><td><strong>101,072</strong> (4.33%)</td></tr><tr><td><strong>Entities</strong></td><td><strong>27,855,373</strong></td><td><strong>1,880,346</strong> (6.75%)</td></tr><tr><td>Habitat</td><td>18,514,216</td><td>1,355,417 (7.32%)</td></tr><tr><td>Microorganism</td><td>8,361,229</td><td>468,021 (5.59%)</td></tr><tr><td>Phenotype</td><td>979,928</td><td>56,908 (5.80%)</td></tr><tr><td><strong>Relation</strong></td><td><strong>7,777,691</strong></td><td><strong>606,717</strong> (7.80%)</td></tr><tr><td>Lives_in</td><td>7,465,205</td><td>587,645 (7.87%)</td></tr><tr><td>Exhibits</td><td>312,486</td><td>19,072 (6.10%)</td></tr></tbody></table>

# 3. Results

## 3.1. Descriptive statistics

We applied the Alvis pipeline to both *Food* and *MicrobioPubMed* corpora. It recognized almost 2 million entities in the *Food* corpus, among which 468,021 microbial taxa, 1,355,417 habitats, and 56,908 phenotypes (see Table 3). This accounts for 6.75% of the classes that were identified in the *MicrobioPubMed* corpus (respectively 5.59%, 7.32% and 5.80% of the *Taxa*, *Habitat* and *Phenotype*). In addition, more than 580,000 *Lives_in* and 19,000 *Exhibits* relations link these entities in the *Food* corpus (corresponding to 7.87% and 6.10% of the two kinds of relations in the *MicrobioPubMed* corpus). The proportion of extracted information is higher than the contribution of the *Food* corpus to the *MicrobioPubMed* corpus, which is 4.3%. The large number of extracted data unveils the amount of knowledge contained in the published documents, and the potential for discovery of additional knowledge.

## 3.2. Online search engine

### 3.2.1. AlvisIR food search engine

The results of the text mining process on the *Food* corpus are made publicly available through the AlvisIR Food search engine (Fig. 5). It is accessible through a web browser to search for information about microorganism phenotypes and habitats at the

location: http://bibliome.jouy.inra.fr/demo/food/alvisir/webapi/search.<fnref n="4" />

**Query interpretation.** The AlvisIR Food search engine is a semantic search engine. It interprets user query terms as taxonomy or ontology concepts, and expands each term with all synonyms and more specific concepts in their respective hierarchies. The result set contains all documents that have been annotated through the text mining process with these concepts.

**Relation query.** The AlvisIR Food search engine also features relational queries that allow the user to search for documents that contain specific relations between entities. This feature is unusual in a bibliographic search engine but more usual in database search. For instance, a user may search for microorganisms that exhibit a given phenotype (e.g. which *Staphylococcus* are anaerobic anaerobe?) or microorganisms that live in a given habitat (e.g. which *Acinetobacter* lives in fruits?). In order to be able to query these different aspects, queries can use special characters. The definition of the different possibilities are specified in the search engine, by clicking on the small icon “i” next to the search bar.

### 3.2.2. Examples of semantic queries

Semantic search by AlvisIR Food handles different cases of synonymy. AlvisIR Food retrieves information for all taxa for a given class including renaming. For example the query *Petromyces* is interpreted as *Aspergillus*, and therefore returns all information related to this genus, since *Petromyces* has been renamed as *Aspergillus* (Samson, 2017), and the synonymy is recorded by the NCBI taxonomy. In addition to all synonymies in the NCBI taxonomy, Alvis also handles common typographic variations (e.g. abbreviation of the genus name).

Synonym management for habitats and phenotypes is more complex since no exhaustive list can be built in advance. The Alvis linguistic processing combined with the OntoBiotope ontology succeeds to capture many variations. For instance, it retrieves equivalent expressions for the sporulating phenotype: “spore-forming”, “endospore-forming” or “sporulation”.<fnref n="5" />

In order to assess the added value of the synonym expansion, we compared the number of entities predicted by Alvis with the number of entities that would have been retrieved by a simple string-matching method, as e.g., Google Scholar does. 66% of entities that Alvis identified in the *MicrobioPubMed* corpus are different from the labels of taxon or ontology concepts, while only

<footnote n="4">⁴ We recommend the following web browsers: Mozilla Firefox, Google Chrome or Internet Explorer. A detailed tutorial on the use of this engine is available at the following address: https://github.com/Bibliome/alvisir/wiki/How-to-use-Alvis-Search-Engine%3F.</footnote>

<footnote n="5">⁵ See this search query example in the AlvisIR Food search engine http://bibliome.jouy.inra.fr/demo/food/alvisir/webapi/search?q=sporulating.</footnote>
<figure><img src="image_10.png" /><figcaption>**Fig. 4.** Quantity of entities (*Microorganisms*, *Habitats* and *Phenotypes*) predicted in the *MicrobioPubMed* corpus. Darker areas represent the proportion of entities that strictly matches a class name; lighter areas represent synonymous entities.</figcaption></figure>

34% are strict matches (as shown on Fig. 4.) Alvis then retrieves in average three times as many entities through synonymy expansion.

Fig. 5 illustrates a relation query: *bacteria lives in "food processing factory"*.<fnref n="6" /> A hit abstract shows that a *Listeria monocytogenes* strain has been isolated in a "raw pork meat processing plant". The green line represents the relation extracted between the bacterium and its habitat. The panel on the right displays the interpretation of the query, in particular synonyms and specializations of the food processing factory query term. This example illustrates the ability of the Alvis pipeline to detect and categorize new habitat terms (i.e. "raw pork meat processing plant") and to link them to bacteria names.

Facets on the left side list microorganisms, habitats and phe-notypes mentioned in the retrieved documents. They can be used to refine the query and target particular concepts, such as other bacteria isolated in the same biotope.

Writing a query may be difficult without knowing OntoBiotope terms. The interface provides a browsing facility that opens by clicking on the button next to the search bar. Fig. 6 shows the "food processing factory" branch from left to right. The user can build queries or refine previous queries by selecting or combining classes in this window.

## 4. Use of text mining results to investigate microbiological questions

The data extracted by text mining methods can be exploited in many ways including the investigation of complex research ques-tions, which require the analysis of large amount of data. In this section, we look at two specific scientific questions to illustrate how text mining results can be used for food microbiology research:

* Which microorganisms have been isolated in fruits?

* Which microorganisms are known to be spore-forming and have been isolated in food products?

### 4.1. Microbiotope of fruits

Fruits can be eaten raw, and undergo few or no preservation processes. The various stages between production and consump-tion, and the external agents bringing germs (birds, transport, consumers touching the products etc.) are sources of microbial contamination (Heaton and Jones, 2008). Preservation processes, such as modified atmospheres or refrigeration may retain a flora in fresh fruits that can be harmful to the consumer; all the more so if the fruit is cut into pieces. The exogenous flora can contaminate the internal part of the fruit, whose intrinsic properties (e.g. water content and sugar resources) may cause microbes to develop (Oliveira et al., 2015).

Knowledge of the flora potentially contaminating a set of given fruits, is a valuable knowledge in many fruit processing applica-tions, such as the design of new fruit desserts like ready-to-eat fruit salads. We propose here to show how text mining can contribute to the study of fruit microbial flora as a first step in the development of food products.

We queried the AlvisIR Food search engine to look for microbes living in fruits in the literature<fnref n="7" />. A query results are shown in Fig. 7. Table 4 shows the statistics of the query result: 10,546 relations are found between 993 unique microorganism classes (with unique NCBI TaxIDs) and 34 food fruit classes in 2,961 documents.

Fig. 8 shows the distribution of the microorganisms for which Alvis detected at least 20 *Lives_in* relations in fruits. We manually checked in documents that the relation was actually expressed at least once. Only three microorganisms, in grey in the figure, were wrongly recognized because of ambiguous acronyms. The main fungi found in fruits are *Saccharomyces cerevisiae*, *Botrytis cinerea*, *Penicillium expansum*, *Aspergillus carbonarius*, *Aspergillus niger*, *Penicillium digitatum*, *Colletotrichum gloeosporioides* and *Colletotrichum acutatum*; and the main bacteria are *Listeria monocytogenes*, *Escherichia coli* (and *E. coli* O157:H7), *Alicyclobacillus acidoterrestris*, *Salmonella enterica* and *Erwinia amylovora*. Our text mining tools also detected rare cases, such as *Povalibacter uvarum* isolated from a Japanese grape (a single relation was mentioned in Nogi et al. (2014)), *Weissella uvarum* found on wine grapes (a single relation mentioned in Nisiotou et al. (2014)), and *Prototheca wickerramii* growing on bananas (three relations mentioned in Pore (1985)).

Fig. 9 shows the distribution of fruit classes mentioned in the query result set. The number of microbial studies reported in literature significantly varies depending on the fruit. For example, in the class "stone fruits", there are 208 *Lives_in* relations from 128 abstracts for the peach, while only 20 relations from 18 abstracts for the nectarine. This case highlights the lack of information about the microbial biodiversity of some fruits.

Using text mining techniques, we can quickly search the bibli-ography. This makes it possible to estimate the potential risks that may exist, for example, in the case of designing a new fruit-based food product or replacing one fruit with another. In fact, text mining helps to identify the taxa of a fruit that could contaminate the final product. This knowledge can be refined by targeting the main microbes known to contaminate the different ingredients of a product (in our case study, the different fruits composing our fruit salad). This type of information from the literature has great po-tential, allowing us to think up the best way to preserve a fruit-based product according to the endogenous flora of each ingredient.

<footnote n="6">⁶ See the example at http://bibliome.jouy.inra.fr/demo/food/alvisir/webapi/search?q=bacteria+lives+in%22food+processing+factory%22+.</footnote>

<footnote n="7">⁷ See this query on-line in the AlvisIR Food search engine http://bibliome.jouy.inra.fr/demo/food/alvisir/webapi/search?q=%7Btaxon%7D*+%7Elivesin+fruit.</footnote>
<figure><img src="image_11.png" /><figcaption>**Fig. 5.** Screenshot of the AlvisIR Food search engine with the *bacteria lives in "food processing factory"* query. To the right are displayed synonyms of *food processing factory*, one of which is *food processing plant*.</figcaption></figure>

<figure><img src="image_12.png" /><figcaption>**Fig. 6.** Screenshot of OntoBiotope browser with food factories displayed.</figcaption></figure>

## 4.2. Sporulating microbes in food

In this section, we assess the potential of text mining for assisting the preparation of a review by comparing the information extracted automatically by text mining to the information of a review paper on a same subject. We selected spore-forming phenotype as a well-delineated subject of high interest for food processing.

### 4.2.1. Biological objective

We focus on the identification of microorganisms that are capable of forming endospores, i.e. structures that allow them to

resist to extreme conditions such as high temperatures, desiccation or high-pressure treatments. These resistant structures cause unwanted contaminations in the food industry, e.g. vegetable cannery (Durand et al., 2015) or milk product manufacture (Ranieri and Boor, 2009). Microbial spores that resist to treatments may contaminate food products, and by extension cause food poisoning (Postollec et al., 2012). Indeed, even though the spore is metabolically inactive, favorable environmental conditions may trigger its germination. Hygienic procedures and the various methods of food preservation, such as UV radiation, reduce the amount of spore-forming bacteria in the final food product (Brown, 2000). However, there are more and more cases where spores contaminate food
Evaluation of Penicillium expansum isolates for aggressiveness, growth and patulin accumulation in usual and less common fruit hosts.

1.4142135

2010 International journal of food microbiology

**Abstract** Experiments were carried out in vivo and in vitro with four isolates of Penicillium expansum (I 1, E 11, C 28 and I 12) to evaluate their aggressiveness, growth and patulin accumulation in both usual (pears and apples) and less common hosts (apricots, peaches, strawberries and kiwifruits) of the pathogen. The 75% of isolates showed the ability to cause blue mould in all tested hosts. In particular, C 28 and I 1 were the most and the least aggressive isolates, respectively (52.9 and 10.6% infection and 20.7 and 15.4 mm lesion diameters). 'Candonga' strawberries and 'Pinkcot' apricots showed the largest lesion diameters (29.8 and 25.3 mm), followed by 'Conference' pears, 'Spring Crest' peaches and 'Abate Fetel' pears. With the exception of 'Candonga' strawberries, the formation of colonies and mycelial growth of P. expansum isolates on fruit puree agar media (PAMs) was stimulated in comparison to a standard growth medium (malt extract agar, MEA). Two of the most aggressive isolates in our assays (I 12 and C 28) showed the greatest accumulation of patulin both in vitro and in vivo, while the least aggressive isolate (I 1) produced patulin only in a few growth media and cvs. Patulin concentration on fruit PAMs was higher than patulin detected in infected fruit tissues.

**Fig. 7.** Screenshot of the AlvisIR Food search engine results to the query (taxon)*-livesin fruit which means "which microorganisms live in fruit?". Curly brackets are used to specify a query about the three main categories of entities, followed by the star * to indicate that they are all to be displayed (and mandatory): i.e. a query with all microorganisms is written as (taxon)*, a query with all habitats as (habitat)* and a query with all phenotypes as (phenotype)*. The presence of the tilde character ~ (which is not mandatory) indicates that a query concerns a relation between entities (here, the Lives_in relation).

<table><caption>**Table 4**
"Microorganisms live in fruit" query statistics.</caption><tr><td>2961</td><td>documents</td></tr><tr><td>10,546</td><td>relations</td></tr><tr><td>993</td><td>unique taxa</td></tr><tr><td>34</td><td>fruit classes</td></tr></table>

and can develop when the conditions were theoretically not favorable, for example at low temperatures (Murphy et al., 1999) or after high heat treatments (Mtimet et al., 2016). Phenotypes of spore-forming bacteria are diverse, both in terms of their behavior towards oxygen and of their resistance to low or high temperatures. It is thus difficult to predict what type of bacterial taxa can be found in preserved food.

### 4.2.2. Methodology

As a source of reference and for comparison, we use the work of Postollec et al. (2012) (and more precisely the first table), which lists spore forming bacteria in food products. 70 bacterial taxa were identified by the authors as such from manually browsing the

literature or from their own expertise. Spore-forming bacteria occurred in various feed and food matrices such as silage, milk, fermented products and meat products.

The text mining procedure is broken down into different stages as presented in Fig. 10. To recover taxa of organisms that are capable of forming spores, and that are also able to grow in food, we computed the intersection of the two lists: the spore-forming taxa and the ones living in food. This was possible because the formation of spores is a phenotype frequently mentioned in different articles. Alvis text mining tools have not been specifically tuned for this task so that this case study can serve as a basis to analyze errors and improve predictions.

The aim of this study is to measure (1) the amount of information that text mining retrieves compared to the review, (2) the amount of information that text mining misses, and (3) the amount of information retrieved that is not in the review and the reason for that. In order to qualify the errors of the text mining process, we will use the nomenclature of error analysis classification: the taxa that were incorrectly identified as spore forming in food are called false positives, and the taxa that were not found but should have been found are called false negatives.
<figure><img src="image_13.png" /><figcaption>**Fig. 8.** Phylogenetic tree of the main microorganisms, virus included, living in fruits as computed by the Alvis tool. The grey numbers are the number of relations extracted from documents. This figure was obtained using the TreeView software (Page, 1996) to view the PHYLIP format export from the NCBI CommonTree online tool, to which we gave the TaxIDs of all microorganisms present in food extracted by text mining processing. In grey, names of microorganisms wrongly recognized.</figcaption></figure>

### 4.2.3. Prediction and comparison

The quantitative results of this experiment are presented in Table 5. The reference from Postollec et al. (2012) lists 70 taxa, among which 64 of specific ranks, strains and species. In the comparison with our findings we counted only once the lowest ranking taxa when two taxa of the same lineage were found (e.g. only *Clostridium perfringens* is counted in the pair *Clostridium* and *Clostridium perfringens*). The Alvis pipeline detects all kind of microbial taxa in the documents, regardless of the reign (bacteria or eukaryotes). The second part of Table 5 shows the results that are specific to bacteria to be compared to the review. The Alvis pipeline found 154 bacteria among which 37 are identical to the reference (58% of the reference). Alvis missed 27 taxa that were in the reference (i.e. 42% false negatives). 117 bacterial taxa were

predicted, but were not in the reference. We have curated each of them by hand; they belong to two categories: 68 taxa were wrongly predicted (false positives) and 49 taxa were actually spore-forming. The Alvis contribution to the total number of spore-forming bacteria (70 plus 49) is then 41%, which represent a very significant increase of the state-of-the-art knowledge compared to the review.

Manual analysis of false positive errors has shown that the wrong prediction of the *Exhibits* link between the taxon and the phenotype is the major source of error (69%). This preliminary work suggests efforts should focus on the improvement of the *Exhibits* relation extraction.

Other false positives are due either to the non-detection of the food entity or to the wrong detection of the relationship *Lives_in* (14%). In the same proportions, incorrect taxon categorization with
<figure><img src="image_14.png" /></figure>

*grape as food* has its own sub-category *wine grape as food* with 41 relations.

<caption>**Fig. 9.** Number of relationships (between brackets) for each OntoBiotope subcategory for the (*taxon*)\* *livesin fruit* query. The count in the highest classes cumulates the number of matches with that same class, as well as with its subclasses.</caption>
<figure><img src="image_15.png" /><figcaption>**Fig. 10.** The text mining experiment workflow to answer the question “what taxa form spores and can live in food?”.</figcaption></figure>

<caption>**Table 5**</caption>

Quantitative results of the experiment on spore-forming taxa. The reference is the article of Postollec et al. (2012).

<table><thead><tr><th colspan="2">All ranks of microorganisms</th></tr></thead><tbody><tr><td>All taxas in Reference</td><td>70</td></tr><tr><td>Predicted by text mining</td><td>256</td></tr><tr><td>True positive (predicted and in Ref)</td><td>43/70</td></tr><tr><td>False Negative (not predicted but in Ref)</td><td>27/70</td></tr><tr><td>False Positive (predicted but wrong)</td><td>107/256</td></tr><tr><td>True positive, not in Ref</td><td>106/256</td></tr></tbody></table>

<table><thead><tr><th colspan="2">Bacteria</th></tr><tr><th colspan="2">(most specific ranks = taxonomic species or strain if available)</th></tr></thead><tbody><tr><td>Taxa (most specific ranks) in Reference</td><td>64</td></tr><tr><td>Predicted Bacteria (most specific ranks)</td><td>154</td></tr><tr><td>True positive (predicted and in Ref)</td><td>37/64</td></tr><tr><td>False Negative (not predicted but in Ref)</td><td>27/64</td></tr><tr><td>False Positive (predicted but wrong)</td><td>68/154</td></tr><tr><td>True positive, not in Ref</td><td>49/154</td></tr></tbody></table>

the NCBI TaxID identifier (16%) induced a wrong Exhibits relation detection. This is due to ambiguous synonyms such as the mention of “strain MS1” in the work of Sankar et al. (2015) to refer to Clos-tridium polynesience, while it is known as the synonym of Alishe-wanella jeotgali in the NCBI taxonomy.

Further examination of false negatives shows that 33% errors (9/27) are due to the lack of information in the corpus; there was no mention of the bacteria with food and/or spore-forming phenotype. 33% (9/27) are due to anaphora, a phenomenon known to be difficult to handle (e.g. microorganisms named only at the begin of

paragraph). 19% (5/27) of the errors are due to missing “Exhibits” relations, and 15% (4/27) are due to missing habitats (e.g. no gelatin word in ontology). Some of these errors are trivial to correct, such as adding terms to the OntoBiotope ontology, or extending the corpus.

In order to further investigate the potential of text mining to complement existing sources of information we studied the content of the *BacDive* database (the DSMZ catalog of bacteria strains) with respect to the spore-forming phenotype. We focused on the 49 correct taxa that were found by text mining but absent of the reference. 30% are present in *BacDive* with the spore-forming phenotype. For instance *Geobacillus kaustophilus* is found in milk (Al-Tamimi et al., 2010), and sporulates (Al-Khalaf et al., 2012). On the other hand, 56% are present in *BacDive* but the phenotype spore-forming is not indicated. For instance *Paenibacillus humicus* is found in beer (Haakensen and Ziola, 2008) and is able to sporulate (Vaz-Moreira et al., 2007). Finally 14% are simply absent from *BacDive*, (e.g. *Coxiella burnetii* which is also found in milk (Hirai et al., 2012), and which has been shown to be capable of making spores (Marrie, 2003)).

These two comparisons illustrates how Alvis text mining tools can be efficiently used to complement existing reviews or databases by extracting relevant information from literature. We estimate the number of errors relatively small compared to the importance of the findings and the gain in time, including the curation time of the text mining results.

## 5. Conclusion

In this article, we proposed a new text mining approach that uses structured knowledge resources to extensively extract a very large amount of information about microorganism habitats and phenotypes from scientific literature in food microbiology. Our proposal addresses the lack of available structured information on this subject. We have detailed the text mining tools i.e. the Alvis platform that uses knowledge resources (i.e. OntoBiotope Habitat and Phenotype ontology) to deal with the high variability of the descriptions of the food microorganism properties. The resulting information is structured by relationships and hierarchies that one can efficiently search by using a semantic search engine, AlvisIR Food.

Through two use cases about a food product, “fruit”, and a phenotype, “spore-forming”, we have demonstrated the potential of Alvis text mining methods for fast literature review on biological questions by the analysis of millions of documents from the PubMed repository. Predicted results, with rapid manual curation, provide a quick overview of such questions that cannot be easily answered by manual bibliography review nor conventional search engines. Our future work will focus on the improvement of extraction of long-distance relations that are frequent in PubMed corpus. We will also update and extend the corpus with full-text papers by using the Alvis pipeline on the European text mining infrastructure OpenMinTeD. OpenMinTeD provides access for text mining tools to millions of documents from digital libraries. Finally, we will develop a database and an application programming interface to facilitate the use of this information by further bioinformatics processing. An example of such processing is checking the consistency of biological experiment results with the literature knowledge, e.g. strain identification in given samples, or hypothesis on the origin of a contamination. Assistance to curation and enrichment of existing databases is another obvious purpose to be developed. We believe that the range of potential uses of text mining in food microbiology is very wide.
Acknowledgements

This work was supported by the OpenMinTeD project (EC/H2020-EINFRA 654021). We would like to thank biologists from the French National Institute for Agricultural Research (Inra) Florilège working group and Food Microbiome project, for their participation in the enrichment of the OntoBiotope Habitat ontology. We would like to thank Olivier Couvert for this advice on spore-forming microorganisms. We are grateful to the Inra MIGALE bioinformatics platform for providing computational resources. We would like to express our gratitude to Philippe Bessières, who is deceased, and who contributed to the preliminary studies of this work.

References

Al-Khalaf, R.A., Al-Awadhi, H.A., Al-Beloshei, N., Afzal, M., 2012. Lipid and fatty acid profile of geobacillus kaustophilus in response to abiotic stress. Can. J. Microbiol. 59 (2), 117–125.

Al-Tamimi, S., Al-Awadi, S., Oommen, S., Afzal, M., 2010. Modification of progesterone and testosterone by a food-borne thermophile geobacillus kaustophilus. Int. J. Food Sci. Nutr. 61 (1), 78–86.

Ananiadou, S., Sullivan, D., Black, W., Levov, G.A., Gillespie, J.J., Mao, C., Pyysalo, S., Kolluru, B., Tsujii, J., Sobral, B., 2011. Named entity recognition for bacterial type IV secretion systems. PLoS One 6 (3) e14780.

Ashburner, M., Ball, C.A., Blake, J.A., Botstein, D., Butler, H., Cherry, J.M., Davis, A.P., Dolinski, K., Dwight, S.S., Eppig, J.T., et al., 2000. Gene ontology: tool for the unification of biology. Nat. Genet. 25 (1), 25–29.

Aubin, S., Hamon, T., 2006. Improving term extraction with terminological resources. In: Advances in Natural Language Processing. Springer, pp. 380–387.

Ba, M., Bossy, R., 2016. Interoperability of corpus processing workflow engines: the case of. AlvisNLP/ML in OpenMinTeD. In: Meeting of Working Group Medicago Sativa. Portorož, Slovenia.

Bessières, P., Bossy, R., Manine, A.P., Alphonse, E., Nédellec, C., 2006. Getting the unknown from the known in bacteria, and the role of text mining. In: Workshop on Data and Text Mining for Integrative Biology, p. 67.

Bokulich, N.A., Lewis, Z.T., Boundy-Mills, K., Mills, D.A., 2016. A new perspective on microbial landscapes within food production. Curr. Opin. Biotechnol. 37, 182–189. Food biotechnology Plant biotechnology.

Bossy, R., Golik, W., Ratkovic, Z., Valsamou, D., Bessieres, P., Nédellec, C., 2015. Overview of the gene regulation network and the bacteria biotope tasks in bionlp'13 shared task. BMC Bioinf. 16 (10), S1.

Bossy, R., Jourde, J., Bessieres, P., Van De Guchte, M., Nédellec, C., 2011. Bionlp shared task 2011: bacteria biotope. In: Proceedings of the BioNLP Shared Task 2011 Workshop. Association for Computational Linguistics, pp. 56–64.

Brown, K.L., 2000. Control of bacterial spores. Br. Med. Bull. 56 (1), 158–171.

Chaix, E., Aubin, S., Deléger, L., Bossy, R., Nédellec, C., 2017. Text-mining needs of the food microbiology research community. In: IN-OVIVE Workshop at EFITA 2017. European Federation for Information Technology in Agriculture, Food and the Environment, Montpellier, France. July 2nd-6th.

Chibucos, M.C., Zweifel, A.E., Herrera, J.C., Meza, W., Eslamfam, S., Uetz, P., Siegele, D.A., Hu, J.C., Giglio, M.G., 2014. An ontology for microbial phenotypes. BMC Microbiol. 14 (1), 294.

Deléger, L., Bossy, R., Chaix, E., Ba, M., Ferré, A., Bessieres, P., Nédellec, C., 2016. Overview of the 4th BioNLP Shared Task Workshop, pp. 12–22.

Doulgeraki, A.I., Ercolini, D., Villani, F., Nychas, G.J.E., 2012. Spoilage microbiota associated to the storage of raw meat in different conditions. Int. J. Food Microbiol. 157 (2), 130–141.

Doyle, M.P., Buchanan, R.L., 2012. Food Microbiology: Fundamentals and Frontiers. American Society for Microbiology Press.

Durand, L., Planchon, S., Guinebretiere, M.H., André, S., Carlin, F., Remize, F., 2015. Contamination pathways of spore-forming bacteria in a vegetable cannery. Int. J. Food Microbiol. 202, 10–19.

EFSA, 2015. The food classification and description system foodex 2 (revision 2). EFSA Supporting Publ. 12 (5), 804E–n/a. 804E.

Escobar-Zepeda, A., de León, A.V.P., Sanchez-Flores, A., 2015. The road to metagenomics: from microbiology to dna sequencing technologies and bioinformatics. Front. Genet. 6.

Federhen, S., Clark, K., Barrett, T., Parkinson, H., Ostell, J., Kodama, Y., Mashima, J., Nakamura, Y., Cochrane, G., Karsch-Mizrachi, I., 2014. Toward richer metadata for microbial sequences: replacing strain-level ncbi taxonomy taxids with bioproject, biosample and assembly records. Stand. Genom. Sci. 9 (3), 1275.

Fleuren, W.W., Alkema, W., 2015. Application of text mining in the biomedical domain. Methods 74, 97–106. Text mining of biomedical literature.

Floyd, M.M., Tang, J., Kane, M., Emerson, D., 2005. Captured diversity in a culture collection: case study of the geographic and habitat distributions of environmental isolates held at the american type culture collection. Appl. Environ. Microbiol. 71 (6), 2813–2823.

Golik, W., Warnier, P., Nédellec, C., 2011. Corpus-based extension of terminology by linguistic analysis: a use case in biomedical event extraction. In:

WS 2 Workshop Extended Abstracts, 9th International Conference on Terminology and Artificial Intelligence, pp. 37–39.

Gruber, T.R., 1993. A translation approach to portable ontology specifications. Knowl. Acquis. 5 (2), 199–220.

Haakensen, M., Ziola, B., 2008. Identification of novel hora-harbouring bacteria capable of spoiling beer. Can. J. Microbiol. 54 (4), 321–325.

Hammi, I., Delalande, F., Belkhou, R., Marchioni, E., Cianferani, S., Ennahar, S., 2016. Maltaricin cpn, a new class iia bacteriocin produced by carnobacterium maltaromaticum cpn isolated from mould-ripened cheese. J. Appl. Microbiol. 121 (5), 1268–1274, 0615.

Heaton, J., Jones, K., 2008. Microbial contamination of fruit and vegetables and the behaviour of enteropathogens in the phyllosphere: a review. J. Appl. Microbiol. 104 (3), 613–626.

Hirai, A., Nakama, A., Chiba, T., Kai, A., 2012. Development of a method for detecting coxiella burnetii in cheese samples. J. Vet. Med. Sci. 74 (2), 175–180.

Ivanova, N., Tringe, S.G., Liolios, K., Liu, W.T., Morrison, N., Hugenholtz, P., Kyrpides, N.C., 2010. A call for standardized classification of metagenome projects. Environ. Microbiol. 12 (7), 1803–1805.

Kelso, J., Hoehndorf, R., Prüfer, K., 2010. Ontologies in biology. In: Theory and Applications of Ontology: Computer Applications. Springer, pp. 347–371.

Kim, J.D., Pyysalo, S., Ohta, T., Bossy, R., Nguyen, N., Tsujii, J., 2011. Overview of bionlp shared task 2011. In: Proceedings of the BioNLP Shared Task 2011 Workshop. Association for Computational Linguistics, Stroudsburg, PA, USA, pp. 1–6. BioNLP Shared Task '11.

Little, C., Knøchel, S., 1994. Growth and survival of yersinia enterocolitica, salmoinella and bacillus cereus in brie stored at 4, 8 and 20c. Int. J. Food Microbiol. 24 (1), 137–145 (Special Issue Food Safety Assurance).

Mao, J., Moore, L.R., Blank, C.E., Wu, E.H.H., Ackerman, M., Ranade, S., Cui, H., 2016. Microbial phenomics information extractor (micropie): a natural language processing tool for the automated acquisition of prokaryotic phenotypic characters from text sources. BMC Bioinf. 17 (1), 528.

Marrie, T., 2003. Coxiella burnetii pneumonia. Eur. Respir. J. 21 (4), 713–719.

Martinez-Rios, V., Dalgaard, P., 2018. Prevalence of listeria monocytogenes in european cheeses: a systematic review and meta-analysis. Food Contr. 84, 205–214.

Montel, M.C., Buchin, S., Mallet, A., Delbes-Paus, C., Vuitton, D.A., Desmasures, N., Berthier, F., 2014. Traditional cheeses: rich and diverse microbiota with associated benefits. Int. J. Food Microbiol. 177, 136–154.

Mtimet, N., Trunet, C., Mathot, A.G., Venaille, L., Leguérinel, I., Coroller, L., Couvert, O., 2016. Die another day: fate of heat-treated geobacillus stearomophorus atcc 12980 spores during storage under growth-preventing conditions. Food Microbiol. 56, 87–95.

Murphy, P.M., Lynch, D., Kelly, P.M., 1999. Growth of thermophilic spore forming bacilli in milk during the manufacture of low heat powders. Int. J. Dairy Technol. 52 (2), 45–50.

Nédellec, C., Bossy, R., Chaix, E., Deléger, L., 2017. Text-mining and ontologies: new approaches to knowledge discovery of microbial diversity. In: Proceedings of the 4th International Microbial Diversity Conference.

Nisiotou, A., Dourou, D., Filippousi, M.E., Banilas, G., Tassou, C., 2014. Weissella uvarum sp. nov., isolated from wine grapes. Int. J. Syst. Evol. Microbiol. 64 (11), 3885–3890.

Nogi, Y., Yoshizumi, M., Hamana, K., Miyazaki, M., Horikoshi, K., 2014. Povalibacter uvarum gen. nov., sp. nov., a polyvinyl-alcohol-degrading bacterium isolated from grapes. Int. J. Syst. Evol. Microbiol. 64 (8), 2712–2717.

Oliveira, M., Abadias, M., Usall, J., Torres, R., Teixidó, N., Viñas, I., 2015. Application of modified atmosphere packaging as a safety approach to fresh-cut fruits and vegetables - a review. Trends Food Sci. Technol. 46 (1), 13–26.

Page, R., 1996. Treeview: an application to display phylogenetic trees on personal computers. Comput. Appl. Biosci. 12, 357–358.

Papazian, F., Bossy, R., Nédellec, C., 2012. Alvisae: a collaborative web text annotation editor for knowledge acquisition. In: Proceedings of the Sixth Linguistic Annotation Workshop. Association for Computational Linguistics, Stroudsburg, PA, USA, pp. 149–152. LAW VI '12.

Pignatelli, M., Moya, A., Tamames, J., 2009. Envdb, a database for describing the environmental distribution of prokaryotic taxa. Environ. Microbiol. Rep. 1 (3), 191–197.

Pore, R.S., 1985. Prototheca associated with banana. Mycopathologia 90 (3), 187–189.

Postollec, F., Mathot, A.G., Bernard, M., Divanac'h, M.L., Pavan, S., Sohier, D., 2012. Tracking spore-forming bacteria in food: from natural biodiversity to selection by processes. Int. J. Food Microbiol. 158 (1), 1–8.

Ranieri, M., Boor, K., 2009. Short communication: bacterial ecology of high-temperature, short-time pasteurized milk processed in the United States. J. Dairy Sci. 92 (10), 4833–4840.

Ratkovic, Z., Golik, W., Warnier, P., 2012. Event extraction of bacteria biotopes: a knowledge-intensive nlp-based approach. BMC Bioinf. 13 (11), 58.

Samson, R., 2017. The mycobiota of food: the current status of taxonomy and biodiversity. In: Proceedings of Microbial Spoilers in Food 2017. ADRIA Développement, p. 95.

Sankar, S.A., Rathored, J., Metidji, S., Lagier, J.C., Khelaifa, S., Labas, N., Musso, D., Raoult, D., Fournier, P.E., 2015. Clostridium polynesiense sp. nov., a new member of the human gut microbiota in French polynesia. Anaerobe 36, 79–87.

Saraoui, T., Leroi, F., Björkroth, J., Pilet, M., 2016. Lactococcus piscium: a psychrotrophic lactic acid bacterium with bioprotective or spoilage activity in food-a review. J. Appl. Microbiol. 121 (4), 907–918, 0110.
Vaz-Moreira, I., Faria, C., Nobre, M.F., Schumann, P., Nunes, O.C., Manaia, C.M., 2007. Paenibacillus humicus sp. nov., isolated from poultry litter compost. Int. J. Syst. Evol. Microbiol. 57 (10), 2267–2271.

Zaremba, S., Ramos-Santacruz, M., Hampton, T., Shetty, P., Fedorko, J., Whitmore, J.,

Greene, J.M., Perna, N.T., Glasner, J.D., Plunkett, G., et al., 2009. Text-mining of pubmed abstracts by natural language processing to create a public knowledge base on molecular mechanisms of bacterial enteropathogens. BMC Bioinf. 10 (1), 177.