Repository: piskvorky/gensim
Pull request: Word2vec coherence
Resolves #1380.

This PR adds a new coherence measure to CoherenceModel, called "c_w2v". This uses word2vec word vectors for computing similarity between terms to calculate coherence. This implementation adds a new accumulator in the text_analysis module that either uses pre-trained KeyedVectors or trains a Word2Vec model on the input corpus to derive KeyedVectors. A new keyword argument keyed_vectors is added to the CoherenceModel to pass in pre-trained vectors.

Rather than requiring parity between the corpus dictionary and the keyed vectors vocabulary, the coherence calculation ignores terms that are missing from the vocabulary (with a warning). This PR also adds a new with_std argument to the get_coherence_per_topic method to calculate the standard deviation between the various segments for each topic. This can serve as some indication of topics that have good overall coherence but a few notable outlier terms or subsets.

Finally, I noticed that the CoherenceModel's method of getting topics from models was implemented in a switch-style manner and refactored it to use polymorphism. Specifically, I introduced a new get_topics method to all topic models that returns the topic-term distributions (except for LSI, which just returns the weights, since its not a real distribution).

Problem statement:
Add a new indirect confirmation measure based on word2vec similarity
#### Description
As introduced in [1], topic coherence can be computed using word2vec similarity of terms. This is roughly compatible with the coherence evaluation framework posited by [2] and currently implemented in gensim. The probability estimation phase will involve training a word2vec model on the given corpus, and the confirmation measure will use the average cosine similarity between context vectors from the word2vec model. [1] did not analyze which segmentation strategy is optimal, but a reasonable guess is to use the same method as "c_v" coherence, since that method also uses context vectors in a semantic space.

The implementation should include the ability to pass in a pre-trained word2vec model or path to the same.

#### Steps/Code/Corpus to Reproduce
I'm envisioning an API something like the following: 
```
cm = CoherenceModel(corpus=corpus, coherence="c_w2v", embeddings="./path-to-model.bin.gz", embeddings_kwargs=dict(binary=True))
# OR
model = gensim.models.KeyedVectors.load_word2vec_format('./GoogleNews-vectors-negative300.bin.gz', binary=True)
cm = CoherenceModel(corpus=corpus, coherence="c_w2v", embeddings=model)
cm.get_coherence()
```

#### Expected Results
<!-- Example: Expected shape of (100,2).-->

#### Actual Results
<!-- Example: Actual shape of (100,5). 

Please paste or specifically describe the actual output or traceback. -->

#### Versions
This should be supported under all versions.

#### References
[1] D. O’Callaghan, D. Greene, J. Carthy, and P. Cunningham, “An analysis of the coherence of descriptors in topic modeling,” Expert Systems with Applications, vol. 42, no. 13, pp. 5645–5657, Aug. 2015.
[2] M. Röder, A. Both, and A. Hinneburg, “Exploring the Space of Topic Coherence Measures,” 2015, pp. 399–408.

Hints from issue discussion:
I'm working on an implementation of this, but it will build on #1349.

Commit message: push fix for setting `topn` in `CoherenceModel.for_topics`

Patch to review:
diff --git a/docs/notebooks/topic_coherence_model_selection.ipynb b/docs/notebooks/topic_coherence_model_selection.ipynb
index e0c0efbd4f..b975a5faab 100644
--- a/docs/notebooks/topic_coherence_model_selection.ipynb
+++ b/docs/notebooks/topic_coherence_model_selection.ipynb
@@ -11,21 +11,28 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 39,
+   "execution_count": 1,
    "metadata": {
     "collapsed": false
    },
-   "outputs": [],
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "Using TensorFlow backend.\n"
+     ]
+    }
+   ],
    "source": [
     "from __future__ import print_function\n",
     "\n",
     "import os\n",
     "import re\n",
+    "from collections import OrderedDict\n",
     "\n",
-    "from gensim.corpora import TextCorpus, MmCorpus\n",
-    "from gensim import utils, models\n",
-    "from gensim.parsing.preprocessing import STOPWORDS\n",
-    "from gensim.utils import deaccent"
+    "from gensim.corpora import TextDirectoryCorpus, MmCorpus\n",
+    "from gensim import utils, models"
    ]
   },
   {
@@ -56,78 +63,7 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 34,
-   "metadata": {
-    "collapsed": true
-   },
-   "outputs": [],
-   "source": [
-    "class TextDirectoryCorpus(TextCorpus):\n",
-    "    \"\"\"Read documents recursively from a directory,\n",
-    "    where each file is interpreted as a plain text document.\n",
-    "    \"\"\"\n",
-    "    \n",
-    "    def iter_filepaths(self):\n",
-    "        \"\"\"Lazily yield paths to each file in the directory structure within the specified\n",
-    "        range of depths. If a filename pattern to match was given, further filter to only\n",
-    "        those filenames that match.\n",
-    "        \"\"\"\n",
-    "        for dirpath, dirnames, filenames in os.walk(self.input):\n",
-    "            for name in filenames:\n",
-    "                yield os.path.join(dirpath, name)\n",
-    "                \n",
-    "    def getstream(self):\n",
-    "        for path in self.iter_filepaths():\n",
-    "            with utils.smart_open(path) as f:\n",
-    "                doc_content = f.read()\n",
-    "            yield doc_content\n",
-    "    \n",
-    "    def preprocess_text(self, text):\n",
-    "        text = deaccent(\n",
-    "            lower_to_unicode(\n",
-    "                strip_multiple_whitespaces(text)))\n",
-    "        tokens = simple_tokenize(text)\n",
-    "        return remove_short(\n",
-    "            remove_stopwords(tokens))\n",
-    "        \n",
-    "    def get_texts(self):\n",
-    "        \"\"\"Iterate over the collection, yielding one document at a time. A document\n",
-    "        is a sequence of words (strings) that can be fed into `Dictionary.doc2bow`.\n",
-    "        Override this function to match your input (parse input files, do any\n",
-    "        text preprocessing, lowercasing, tokenizing etc.). There will be no further\n",
-    "        preprocessing of the words coming out of this function.\n",
-    "        \"\"\"\n",
-    "        lines = self.getstream()\n",
-    "        if self.metadata:\n",
-    "            for lineno, line in enumerate(lines):\n",
-    "                yield self.preprocess_text(line), (lineno,)\n",
-    "        else:\n",
-    "            for line in lines:\n",
-    "                yield self.preprocess_text(line)\n",
-    "\n",
-    "    \n",
-    "def remove_stopwords(tokens, stopwords=STOPWORDS):\n",
-    "    return [token for token in tokens if token not in stopwords]\n",
-    "\n",
-    "def remove_short(tokens, minsize=3):\n",
-    "    return [token for token in tokens if len(token) >= minsize]\n",
-    "\n",
-    "def lower_to_unicode(text):\n",
-    "    return utils.to_unicode(text.lower(), 'ascii', 'ignore')\n",
-    "\n",
-    "RE_WHITESPACE = re.compile(r\"(\\s)+\", re.UNICODE)\n",
-    "def strip_multiple_whitespaces(text):\n",
-    "    return RE_WHITESPACE.sub(\" \", text)\n",
-    "\n",
-    "PAT_ALPHABETIC = re.compile('(((?![\\d])\\w)+)', re.UNICODE)\n",
-    "def simple_tokenize(text):\n",
-    "    for match in PAT_ALPHABETIC.finditer(text):\n",
-    "        yield match.group()"
-   ]
-  },
-  {
-   "cell_type": "code",
-   "execution_count": 35,
+   "execution_count": 2,
    "metadata": {
     "collapsed": false
    },
@@ -136,15 +72,20 @@
     "class NewsgroupCorpus(TextDirectoryCorpus):\n",
     "    \"\"\"Parse 20 Newsgroups dataset.\"\"\"\n",
     "\n",
-    "    def extract_body(self, text):\n",
-    "        return strip_newsgroup_header(\n",
-    "            strip_newsgroup_footer(\n",
-    "                strip_newsgroup_quoting(text)))\n",
+    "    def getstream(self):\n",
+    "        for text in super(NewsgroupCorpus, self).getstream():\n",
+    "            yield utils.to_unicode(text, encoding='latin')\n",
     "\n",
     "    def preprocess_text(self, text):\n",
-    "        body = self.extract_body(text)\n",
+    "        body = extract_body(text)\n",
     "        return super(NewsgroupCorpus, self).preprocess_text(body)\n",
     "\n",
+    "    \n",
+    "def extract_body(text):\n",
+    "    return strip_newsgroup_header(\n",
+    "        strip_newsgroup_footer(\n",
+    "            strip_newsgroup_quoting(text)))\n",
+    "\n",
     "\n",
     "def strip_newsgroup_header(text):\n",
     "    \"\"\"Given text in \"news\" format, strip the headers, by removing everything\n",
@@ -186,7 +127,7 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 36,
+   "execution_count": 3,
    "metadata": {
     "collapsed": true
    },
@@ -203,7 +144,7 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 49,
+   "execution_count": 4,
    "metadata": {
     "collapsed": false
    },
@@ -213,9 +154,9 @@
      "output_type": "stream",
      "text": [
       "19998\n",
-      "Dictionary(107980 unique tokens: [u'jbwn', u'porkification', u'sowell', u'sonja', u'luanch']...)\n",
-      "CPU times: user 38.3 s, sys: 2.43 s, total: 40.7 s\n",
-      "Wall time: 43.7 s\n"
+      "Dictionary(24593 unique tokens: [u'woods', u'hanging', u'woody', u'localized', u'gaa']...)\n",
+      "CPU times: user 20 s, sys: 797 ms, total: 20.8 s\n",
+      "Wall time: 21.1 s\n"
      ]
     }
    ],
@@ -223,6 +164,7 @@
     "%%time\n",
     "\n",
     "corpus = NewsgroupCorpus(data_path)\n",
+    "corpus.dictionary.filter_extremes(no_below=5, no_above=0.8)\n",
     "dictionary = corpus.dictionary\n",
     "print(len(corpus))\n",
     "print(dictionary)"
@@ -230,7 +172,7 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 38,
+   "execution_count": 5,
    "metadata": {
     "collapsed": false
    },
@@ -239,8 +181,8 @@
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "CPU times: user 25.9 s, sys: 2.76 s, total: 28.7 s\n",
-      "Wall time: 34 s\n"
+      "CPU times: user 25.1 s, sys: 1.09 s, total: 26.1 s\n",
+      "Wall time: 26.6 s\n"
      ]
     }
    ],
@@ -265,7 +207,7 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 40,
+   "execution_count": 13,
    "metadata": {
     "collapsed": false
    },
@@ -283,26 +225,66 @@
       "Training LDA(k=80)\n",
       "Training LDA(k=90)\n",
       "Training LDA(k=100)\n",
-      "CPU times: user 1h 27min 7s, sys: 7min 54s, total: 1h 35min 2s\n",
-      "Wall time: 1h 3min 27s\n"
+      "CPU times: user 20min 42s, sys: 3min 13s, total: 23min 56s\n",
+      "Wall time: 23min 54s\n"
      ]
     }
    ],
    "source": [
     "%%time\n",
     "\n",
-    "trained_models = {}\n",
+    "trained_models = OrderedDict()\n",
     "for num_topics in range(20, 101, 10):\n",
     "    print(\"Training LDA(k=%d)\" % num_topics)\n",
     "    lda = models.LdaMulticore(\n",
     "        mm_corpus, id2word=dictionary, num_topics=num_topics, workers=4,\n",
-    "        passes=10, iterations=200, random_state=42,\n",
+    "        passes=10, iterations=100, random_state=42, eval_every=None,\n",
     "        alpha='asymmetric',  # shown to be better than symmetric in most cases\n",
     "        decay=0.5, offset=64  # best params from Hoffman paper\n",
     "    )\n",
     "    trained_models[num_topics] = lda"
    ]
   },
+  {
+   "cell_type": "code",
+   "execution_count": 6,
+   "metadata": {
+    "collapsed": true
+   },
+   "outputs": [],
+   "source": [
+    "# Some useful utility functions in case you want to save your models.\n",
+    "\n",
+    "models_dir = os.path.join(home, 'workshop', 'nlp', 'models')\n",
+    "\n",
+    "def save_models(named_models):\n",
+    "    for num_topics, model in named_models.items():\n",
+    "        model_path = os.path.join(models_dir, 'lda-newsgroups-k%d.lda' % num_topics)\n",
+    "        model.save(model_path, separately=False)\n",
+    "\n",
+    "        \n",
+    "def load_models():\n",
+    "    trained_models = OrderedDict()\n",
+    "    for num_topics in range(20, 101, 10):\n",
+    "        model_path = os.path.join(models_dir, 'lda-newsgroups-k%d.lda' % num_topics)\n",
+    "        print(\"Loading LDA(k=%d) from %s\" % (num_topics, model_path))\n",
+    "        trained_models[num_topics] = models.LdaMulticore.load(model_path)\n",
+    "\n",
+    "    return trained_models"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [],
+   "source": [
+    "# save_models(trained_models)\n",
+    "# trained_models = load_models()"
+   ]
+  },
   {
    "cell_type": "markdown",
    "metadata": {},
@@ -318,7 +300,7 @@
   },
   {
    "cell_type": "code",
-   "execution_count": 53,
+   "execution_count": 8,
    "metadata": {
     "collapsed": false
    },
@@ -327,39 +309,159 @@
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "Number of relevant terms: 3517\n"
+      "CPU times: user 41.3 s, sys: 2.42 s, total: 43.7 s\n",
+      "Wall time: 1min 26s\n"
      ]
     }
    ],
    "source": [
-    "# Build topic listings from each model.\n",
-    "import itertools\n",
-    "from gensim import matutils\n",
+    "%%time\n",
+    "\n",
+    "# Now estimate the probabilities for the CoherenceModel.\n",
+    "# This performs a single pass over the reference corpus, accumulating\n",
+    "# the necessary statistics for all of the models at once.\n",
+    "cm = models.CoherenceModel.for_models(\n",
+    "    trained_models.values(), dictionary, texts=corpus.get_texts(), coherence='c_v')"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 10,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "CPU times: user 1min 9s, sys: 441 ms, total: 1min 9s\n",
+      "Wall time: 1min 10s\n"
+     ]
+    }
+   ],
+   "source": [
+    "%%time\n",
     "\n",
+    "coherence_estimates = cm.compare_models(trained_models.values())\n",
+    "coherences = dict(zip(trained_models.keys(), coherence_estimates))"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 11,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [],
+   "source": [
+    "def print_coherence_rankings(coherences):\n",
+    "    avg_coherence = \\\n",
+    "        [(num_topics, avg_coherence)\n",
+    "         for num_topics, (_, avg_coherence) in coherences.items()]\n",
+    "    ranked = sorted(avg_coherence, key=lambda tup: tup[1], reverse=True)\n",
+    "    print(\"Ranked by average '%s' coherence:\\n\" % cm.coherence)\n",
+    "    for item in ranked:\n",
+    "        print(\"num_topics=%d:\\t%.4f\" % item)\n",
+    "    print(\"\\nBest: %d\" % ranked[0][0])"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 12,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Ranked by average 'c_v' coherence:\n",
+      "\n",
+      "num_topics=20:\t0.5614\n",
+      "num_topics=50:\t0.5522\n",
+      "num_topics=30:\t0.5385\n",
+      "num_topics=80:\t0.5286\n",
+      "num_topics=40:\t0.5239\n",
+      "num_topics=70:\t0.5189\n",
+      "num_topics=100:\t0.5140\n",
+      "num_topics=60:\t0.5090\n",
+      "num_topics=90:\t0.4824\n",
+      "\n",
+      "Best: 20\n"
+     ]
+    }
+   ],
+   "source": [
+    "print_coherence_rankings(coherences)"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "### Results so Far\n",
     "\n",
-    "def top_topics(lda, num_words=20):\n",
-    "    str_topics = []\n",
-    "    for topic in lda.state.get_lambda():\n",
-    "        topic = topic / topic.sum()  # normalize to probability distribution\n",
-    "        bestn = matutils.argsort(topic, topn=num_words, reverse=True)\n",
-    "        beststr = [lda.id2word[_id] for _id in bestn]\n",
-    "        str_topics.append(beststr)\n",
-    "    return str_topics\n",
+    "So far in this notebook, we have used `gensim`'s `CoherenceModel` to perform model selection over the number of topics for LDA. We found that for the 20 Newsgroups corpus, 20 topics is indeed best. We showcased the ability of the coherence pipeline to evaluate individual aggregated model coherence (Note that the individual topic coherence is also computed by `cm.compare_models`). We also demonstrated how to avoid repeated passes over the corpus, estimating the term similarity probabilities for all relevant terms just once. Topic coherence is a powerful alternative to evaluation using perplexity on a held-out document set. It is appropriate to use whenever the objective of the topic modeling is to present the topics as top-N lists for human consumption.\n",
     "\n",
+    "Note that coherence calculations are generally much more accurate when a larger reference corpus is used to estimate the probabilities. In this case, we used the same corpus as for our modeling, which is relatively small at only 20,000 documents. A better reference corpus is the full Wikipedia corpus. The motivated explorer of this notebook is encouraged to download that corpus (see [Experiments on the English Wikipedia](https://radimrehurek.com/gensim/wiki.html)) and use it for probability estimation.\n",
+    "\n",
+    "Next we'll look at another method of coherence evaluation using distributional word embeddings."
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {
+    "collapsed": true
+   },
+   "source": [
+    "### Evaluating Coherence with Word2Vec\n",
+    "\n",
+    "The fact that \"c_v\" coherence uses distributional semantics to evalaute word similarity motivates the use of Word2Vec for coherence evaluation. This idea is explored further in an appendix at the end of the notebook. The `CoherenceModel` implemented in `gensim` also supports this, so let's look at a few examples."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 16,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "CPU times: user 3min 25s, sys: 5.71 s, total: 3min 31s\n",
+      "Wall time: 2min 11s\n"
+     ]
+    }
+   ],
+   "source": [
+    "%%time\n",
     "\n",
-    "model_topics = {}\n",
-    "super_topic = set()\n",
-    "for num_topics, model in trained_models.items():\n",
-    "    topics_as_topn_terms = top_topics(model)\n",
-    "    model_topics[num_topics] = topics_as_topn_terms\n",
-    "    super_topic.update(itertools.chain.from_iterable(topics_as_topn_terms))\n",
+    "class TextsIterable(object):\n",
+    "    \"\"\"Wrap a TextCorpus in something that yields texts from its __iter__.\n",
     "    \n",
-    "print(\"Number of relevant terms: %d\" % len(super_topic))"
+    "    It's necessary to use this because the Word2Vec model is built by scanning\n",
+    "    over the texts several times. Passing in corpus.get_texts() would result in\n",
+    "    an empty iterable on passes after the first.\n",
+    "    \"\"\"\n",
+    "    \n",
+    "    def __init__(self, corpus):\n",
+    "        self.corpus = corpus\n",
+    "    \n",
+    "    def __iter__(self):\n",
+    "        return self.corpus.get_texts()\n",
+    "\n",
+    "\n",
+    "cm = models.CoherenceModel.for_models(\n",
+    "    trained_models.values(), dictionary, texts=TextsIterable(corpus), coherence='c_w2v')"
    ]
   },
   {
    "cell_type": "code",
-   "execution_count": 54,
+   "execution_count": 17,
    "metadata": {
     "collapsed": false
    },
@@ -368,24 +470,48 @@
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "CPU times: user 34 s, sys: 3.1 s, total: 37.1 s\n",
-      "Wall time: 56.9 s\n"
+      "Ranked by average 'c_w2v' coherence:\n",
+      "\n",
+      "num_topics=80:\t0.7491\n",
+      "num_topics=100:\t0.7455\n",
+      "num_topics=90:\t0.7388\n",
+      "num_topics=70:\t0.7327\n",
+      "num_topics=50:\t0.7301\n",
+      "num_topics=60:\t0.7285\n",
+      "num_topics=40:\t0.7136\n",
+      "num_topics=30:\t0.7061\n",
+      "num_topics=20:\t0.6865\n",
+      "\n",
+      "Best: 80\n",
+      "CPU times: user 2.55 s, sys: 98.3 ms, total: 2.65 s\n",
+      "Wall time: 2.65 s\n"
      ]
     }
    ],
    "source": [
     "%%time\n",
-    "# Now estimate the probabilities for the CoherenceModel\n",
     "\n",
-    "cm = models.CoherenceModel(\n",
-    "    topics=[super_topic], texts=corpus.get_texts(),\n",
-    "    dictionary=dictionary, coherence='c_v')\n",
-    "cm.estimate_probabilities()"
+    "coherence_estimates = cm.compare_models(trained_models.values())\n",
+    "coherences = dict(zip(trained_models.keys(), coherence_estimates))\n",
+    "print_coherence_rankings(coherences)"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "#### Using pre-trained word vectors for coherence evaluation.\n",
+    "\n",
+    "Whoa! These results are completely different from those of the \"c_v\" method, and \"c_w2v\" is saying the model we thought was best is actually the worst! So what happened here?\n",
+    "\n",
+    "The same note must be made for Word2Vec (\"c_w2v\") that we made for \"c_v\": results are more accurate when a larger reference corpus is used. Except for \"c_w2v\", this is actually _way, way_ more important. Distributional word embedding techniques such as Word2Vec are fitting a probability distribution with a large number of parameters, and doing that takes a lot of data.\n",
+    "\n",
+    "Luckily, there are a variety of pre-trained word vectors [freely available for download](http://ahogrammer.com/2017/01/20/the-list-of-pretrained-word-embeddings/). Below we demonstrate using word vectors trained on ~100 billion words from Google News, [available at this link](https://drive.google.com/file/d/0B7XkCwpI5KDYNlNUTTlSS21pQmM/edit?usp=sharing). Note that this file is 1.5G, so downloading it can take quite some time. It is also quite slow to load and ends up occupying about 3.35G in memory (this load time is included in the timing below). There is no need to use such a large set of word vectors for this evaluation; this one is just readily available."
    ]
   },
   {
    "cell_type": "code",
-   "execution_count": 64,
+   "execution_count": 32,
    "metadata": {
     "collapsed": false
    },
@@ -394,109 +520,3275 @@
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "Avg coherence for num_topics=100: 0.48958\n",
-      "Avg coherence for num_topics=70: 0.50393\n",
-      "Avg coherence for num_topics=40: 0.51029\n",
-      "Avg coherence for num_topics=80: 0.51147\n",
-      "Avg coherence for num_topics=50: 0.51582\n",
-      "Avg coherence for num_topics=20: 0.49602\n",
-      "Avg coherence for num_topics=90: 0.47067\n",
-      "Avg coherence for num_topics=60: 0.48913\n",
-      "Avg coherence for num_topics=30: 0.48709\n",
-      "CPU times: user 2min 39s, sys: 524 ms, total: 2min 39s\n",
-      "Wall time: 2min 40s\n"
+      "CPU times: user 3min 5s, sys: 8.26 s, total: 3min 13s\n",
+      "Wall time: 3min 15s\n"
      ]
     }
    ],
    "source": [
     "%%time\n",
-    "import numpy as np\n",
-    "# Next we perform the coherence evaluation for each of the models.\n",
-    "# Since we have already precomputed the probabilities, this simply\n",
-    "# involves using the accumulated stats in the `CoherenceModel` to\n",
-    "# perform the evaluations, which should be pretty quick.\n",
-    "\n",
-    "coherences = {}\n",
-    "for num_topics, topics in model_topics.items():\n",
-    "    cm.topics = topics\n",
-    "\n",
-    "    # We evaluate at various values of N and average them. This is a more robust,\n",
-    "    # according to: http://people.eng.unimelb.edu.au/tbaldwin/pubs/naacl2016.pdf\n",
-    "    coherence_at_n = {}\n",
-    "    for n in (20, 15, 10, 5):\n",
-    "        cm.topn = n\n",
-    "        topic_coherences = cm.get_coherence_per_topic()\n",
-    "        \n",
-    "        # Let's record the coherences for each topic, as well as the aggregated\n",
-    "        # coherence across all of the topics.\n",
-    "        coherence_at_n[n] = (topic_coherences, cm.aggregate_measures(topic_coherences))\n",
-    "        \n",
-    "    topic_coherences, avg_coherences = zip(*coherence_at_n.values())\n",
-    "    avg_topic_coherences = np.vstack(topic_coherences).mean(0)\n",
-    "    avg_coherence = np.mean(avg_coherences)\n",
-    "    print(\"Avg coherence for num_topics=%d: %.5f\" % (num_topics, avg_coherence))\n",
-    "    coherences[num_topics] = (avg_topic_coherences, avg_coherence)"
+    "\n",
+    "models_dir = os.path.join(home, 'workshop', 'nlp', 'models')\n",
+    "vectors_path = os.path.join(models_dir, 'GoogleNews-vectors-negative300.bin.gz')\n",
+    "keyed_vectors = models.KeyedVectors.load_word2vec_format(vectors_path, binary=True)\n",
+    "\n",
+    "# still need to estimate_probabilities, but corpus is not scanned\n",
+    "cm = models.CoherenceModel.for_models(\n",
+    "    trained_models.values(), dictionary, texts=corpus.get_texts(),\n",
+    "    coherence='c_w2v', keyed_vectors=keyed_vectors)"
    ]
   },
   {
    "cell_type": "code",
-   "execution_count": 68,
+   "execution_count": 33,
    "metadata": {
     "collapsed": false
    },
    "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n"
+     ]
+    },
     {
      "name": "stdout",
      "output_type": "stream",
      "text": [
-      "Ranked by average 'c_v' coherence:\n",
+      "Ranked by average 'c_w2v' coherence:\n",
       "\n",
-      "num_topics=50:\t0.5158\n",
-      "num_topics=80:\t0.5115\n",
-      "num_topics=40:\t0.5103\n",
-      "num_topics=70:\t0.5039\n",
-      "num_topics=20:\t0.4960\n",
-      "num_topics=100:\t0.4896\n",
-      "num_topics=60:\t0.4891\n",
-      "num_topics=30:\t0.4871\n",
-      "num_topics=90:\t0.4707\n",
+      "num_topics=50:\t0.5004\n",
+      "num_topics=40:\t0.4988\n",
+      "num_topics=30:\t0.4966\n",
+      "num_topics=60:\t0.4959\n",
+      "num_topics=20:\t0.4943\n",
+      "num_topics=70:\t0.4920\n",
+      "num_topics=80:\t0.4882\n",
+      "num_topics=90:\t0.4821\n",
+      "num_topics=100:\t0.4803\n",
       "\n",
-      "Best: 50\n"
+      "Best: 50\n",
+      "CPU times: user 5.21 s, sys: 1.22 s, total: 6.43 s\n",
+      "Wall time: 5.78 s\n"
      ]
     }
    ],
    "source": [
-    "# Print the coherence rankings\n",
+    "%%time\n",
     "\n",
-    "avg_coherence = \\\n",
-    "    [(num_topics, avg_coherence)\n",
-    "     for num_topics, (_, avg_coherence) in coherences.items()]\n",
-    "ranked = sorted(avg_coherence, key=lambda tup: tup[1], reverse=True)\n",
-    "print(\"Ranked by average '%s' coherence:\\n\" % cm.coherence)\n",
-    "for item in ranked:\n",
-    "    print(\"num_topics=%d:\\t%.4f\" % item)\n",
-    "print(\"\\nBest: %d\" % ranked[0][0])"
+    "coherence_estimates = cm.compare_models(trained_models.values())\n",
+    "coherences = dict(zip(trained_models.keys(), coherence_estimates))\n",
+    "print_coherence_rankings(coherences)"
    ]
   },
   {
    "cell_type": "markdown",
    "metadata": {},
    "source": [
-    "## Conclusion\n",
+    "#### Watch out for Out-of-Vocabulary (OOV) terms!\n",
     "\n",
-    "In this notebook, we used `gensim`'s `CoherenceModel` to perform model selection over the number of topics for LDA. We found that for the 20 Newsgroups corpus, 50 topics is best. We showcased the ability of the coherence pipeline to evaluate individual topic coherence as well as aggregated model coherence. We also demonstrated how to avoid repeated passes over the corpus, estimating the term similarity probabilities for all relevant terms just once. Topic coherence is a powerful alternative to evaluation using perplexity on a held-out document set. It is appropriate to use whenever the objective of the topic modeling is to present the topics as top-N lists for human consumption.\n",
+    "At first glance, it might seem like the \"c_w2v\" coherence with the GoogleNews vectors disagrees quite a bit with the \"c_v\" method and doesn't seem to improve on training on the newsgroups corpus. If you run the above code with debug logging enabled, you'll notice a TON of logging messages stating something like \"at least one topic word not in word2vec model.\" This is a real gotcha to watch out for! Pre-trained word vectors means there is likely to be some vocabulary mismatch. So unless the corpus you're modeling on was included in the training data for the vectors, you need to watch out for this. In the results above, it is easy to diagnose because all of the models have very similar coherence rankings. You can use the function below to dig in and see exactly how bad the issue is."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 34,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "number of oov words: 407\n",
+      "number of oov words for num_topics=20: 19\n",
+      "number of oov words for num_topics=30: 54\n",
+      "number of oov words for num_topics=40: 81\n",
+      "number of oov words for num_topics=50: 99\n",
+      "number of oov words for num_topics=60: 121\n",
+      "number of oov words for num_topics=70: 136\n",
+      "number of oov words for num_topics=80: 201\n",
+      "number of oov words for num_topics=90: 181\n",
+      "number of oov words for num_topics=100: 198\n"
+     ]
+    }
+   ],
+   "source": [
+    "import itertools\n",
     "\n",
-    "Note that coherence calculations are generally much more accurate when a larger reference corpus is used to estimate the probabilities. In this case, we used the same corpus as for our modeling, which is relatively small at only 20 documents. A better reference corpus is the full Wikipedia corpus. The motivated explorer of this notebook is encouraged to download that corpus (see [Experiments on the English Wikipedia](https://radimrehurek.com/gensim/wiki.html)) and use it for probability estimation."
+    "\n",
+    "def report_on_oov_terms(cm, topic_models):\n",
+    "    \"\"\"OOV = out-of-vocabulary\"\"\"\n",
+    "    vectors = cm._accumulator.model\n",
+    "    topics_as_topn_terms = [\n",
+    "        models.CoherenceModel.top_topics_as_word_lists(model, dictionary)\n",
+    "        for model in topic_models\n",
+    "    ]\n",
+    "\n",
+    "    super_topic = set()\n",
+    "    for topic in topics_as_topn_terms:\n",
+    "        super_topic.update(itertools.chain.from_iterable(topic))\n",
+    "\n",
+    "    oov_words = [word for word in super_topic if word not in vectors.vocab]\n",
+    "    print('number of oov words: %d' % len(oov_words))\n",
+    "    for num_topics, words in zip(trained_models.keys(), topics_as_topn_terms):\n",
+    "        flat_words = itertools.chain.from_iterable(words)\n",
+    "        oov_words = [word for word in flat_words if word not in vectors.vocab]\n",
+    "        print('number of oov words for num_topics=%d: %d' % (num_topics, len(oov_words)))\n",
+    "\n",
+    "report_on_oov_terms(cm, trained_models.values())"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "*Yikes!* That's a lot of terms that are being ignored when calculating the coherence metrics. So these results are not really reliable. Let's use a different set of pre-trained word vectors. I trained these on a recent Wikipedia dump using skip-gram negative sampling (SGNS) with a context window of 5 and 300 dimensions."
    ]
   },
   {
    "cell_type": "code",
-   "execution_count": null,
+   "execution_count": 26,
    "metadata": {
     "collapsed": true
    },
    "outputs": [],
-   "source": []
+   "source": [
+    "vectors_path = os.path.join(models_dir, 'wiki-en_sgns5-w5-s300.bin.gz')\n",
+    "keyed_vectors = models.KeyedVectors.load_word2vec_format(vectors_path, binary=True)\n",
+    "\n",
+    "# still need to estimate_probabilities, but corpus is not scanned\n",
+    "cm = models.CoherenceModel.for_models(\n",
+    "    trained_models.values(), dictionary, texts=corpus.get_texts(),\n",
+    "    coherence='c_w2v', keyed_vectors=keyed_vectors)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 27,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n",
+      "WARNING:gensim.topic_coherence.indirect_confirmation_measure:at least one topic word not in word2vec model\n"
+     ]
+    },
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "Ranked by average 'c_w2v' coherence:\n",
+      "\n",
+      "num_topics=20:\t0.5812\n",
+      "num_topics=30:\t0.5804\n",
+      "num_topics=50:\t0.5761\n",
+      "num_topics=40:\t0.5740\n",
+      "num_topics=60:\t0.5681\n",
+      "num_topics=70:\t0.5634\n",
+      "num_topics=80:\t0.5596\n",
+      "num_topics=100:\t0.5567\n",
+      "num_topics=90:\t0.5559\n",
+      "\n",
+      "Best: 20\n",
+      "CPU times: user 3.2 s, sys: 244 ms, total: 3.44 s\n",
+      "Wall time: 3.36 s\n"
+     ]
+    }
+   ],
+   "source": [
+    "%%time\n",
+    "\n",
+    "coherence_estimates = cm.compare_models(trained_models.values())\n",
+    "coherences = dict(zip(trained_models.keys(), coherence_estimates))\n",
+    "print_coherence_rankings(coherences)"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 31,
+   "metadata": {
+    "collapsed": false
+   },
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "number of oov words: 80\n",
+      "number of oov words for num_topics=20: 1\n",
+      "number of oov words for num_topics=30: 9\n",
+      "number of oov words for num_topics=40: 17\n",
+      "number of oov words for num_topics=50: 9\n",
+      "number of oov words for num_topics=60: 19\n",
+      "number of oov words for num_topics=70: 24\n",
+      "number of oov words for num_topics=80: 30\n",
+      "number of oov words for num_topics=90: 33\n",
+      "number of oov words for num_topics=100: 26\n"
+     ]
+    }
+   ],
+   "source": [
+    "report_on_oov_terms(cm, trained_models.values())"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "#### Looks like we've now restored order\n",
+    "\n",
+    "The results with the Wikipedia-trained word vectors are much better because we have less terms OOV. The \"c_w2v\" evalution is now agreeing with \"c_v\" on the best model, and the rest of the ordering is generally similar. Note that the \"c_w2v\" values should not be compared directly to those produced by the \"c_v\" method. Only the ranking of models is comparable."
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "## Appendix: Why Word2Vec for Coherence?\n",
+    "\n",
+    "The \"c_v\" coherence method drags a sliding window across all documents in the corpus to accumulate co-occurrence statistics. Similarity is calculated using normalized pointwise mutual information (PMI) values estimated from these statistics. More specifically, each word is represented by a vector of its NPMI with every other word in its top-N topic list. These vectors are then used to compute (cosine) similarity between words. The restriction to the other words in the top-N list was found to produce better results than using the entire vocabulary and other methods of reducing the vocabulary (see section 3.2.2 of http://www.aclweb.org/anthology/W13-0102).\n",
+    "\n",
+    "The fact that a reduced space is superior for these metrics indicates there is noise getting in the way. The \"c_v\" method can be seen as constructing an NPMI matrix between words. The vector of NPMI values for a particular word can then be looked up by indexing the row or column corresponding to that word's `Dictionary` ID. The reduction to the \"topic word space\" can then be achieved by using a mask to select out the top-N topic words. If we are constructing an NPMI matrix between words, then discarding some elements to reduce noise, why not factorize the matrix instead? Dimensionality reduction techniques such as SVD do a great job of reducing noise along with dimensionality, while also providing a compressed representation to work with.\n",
+    "\n",
+    "[Recent work](https://papers.nips.cc/paper/5477-neural-word-embedding-as-implicit-matrix-factorization) has shown that Word2Vec (trained with Skip-Gram Negative Sampling (SGNS)) is actually implicitly factorizing a PMI matrix shifted by a positive constant. [A subsequent paper](http://dl.acm.org/citation.cfm?id=2914720) compared Word2Vec to a few different PMI-based metrics and showed that it found coherence values that correlated more strongly with human judgements."
+   ]
   }
  ],
  "metadata": {
diff --git a/gensim/corpora/__init__.py b/gensim/corpora/__init__.py
index a11a0df229..efb9c628ae 100644
--- a/gensim/corpora/__init__.py
+++ b/gensim/corpora/__init__.py
@@ -2,16 +2,15 @@
 This package contains implementations of various streaming corpus I/O format.
 """
 
+from .indexedcorpus import IndexedCorpus  # must appear before the other classes
 # bring corpus classes directly into package namespace, to save some typing
-from .indexedcorpus import IndexedCorpus # must appear before the other classes
-
-from .mmcorpus import MmCorpus
 from .bleicorpus import BleiCorpus
-from .svmlightcorpus import SvmLightCorpus
-from .lowcorpus import LowCorpus
 from .dictionary import Dictionary
 from .hashdictionary import HashDictionary
-from .wikicorpus import WikiCorpus
-from .textcorpus import TextCorpus
-from .ucicorpus import UciCorpus
+from .lowcorpus import LowCorpus
 from .malletcorpus import MalletCorpus
+from .mmcorpus import MmCorpus
+from .svmlightcorpus import SvmLightCorpus
+from .textcorpus import TextCorpus, TextDirectoryCorpus
+from .ucicorpus import UciCorpus
+from .wikicorpus import WikiCorpus
diff --git a/gensim/models/basemodel.py b/gensim/models/basemodel.py
index cba87a9d70..eb6071e8dd 100644
--- a/gensim/models/basemodel.py
+++ b/gensim/models/basemodel.py
@@ -14,3 +14,11 @@ def print_topics(self, num_topics=20, num_words=10):
         probable words for `topics` number of topics to log.
         Set `topics=-1` to print all topics."""
         return self.show_topics(num_topics=num_topics, num_words=num_words, log=True)
+
+    def get_topics(self):
+        """
+        Returns:
+            np.ndarray: `num_topics` x `vocabulary_size` array of floats which represents
+            the term topic matrix learned during inference.
+        """
+        raise NotImplementedError
diff --git a/gensim/models/coherencemodel.py b/gensim/models/coherencemodel.py
index 95a5117eee..1917241fda 100644
--- a/gensim/models/coherencemodel.py
+++ b/gensim/models/coherencemodel.py
@@ -18,14 +18,13 @@
   coherence measures. http://svn.aksw.org/papers/2015/WSDM_Topic_Evaluation/public.pdf.
 """
 
+import itertools
 import logging
 import multiprocessing as mp
 from collections import namedtuple
 
 import numpy as np
-
-from gensim import interfaces
-from gensim.matutils import argsort
+from gensim import interfaces, matutils
 from gensim.topic_coherence import (segmentation, probability_estimation,
                                     direct_confirmation_measure, indirect_confirmation_measure,
                                     aggregation)
@@ -34,10 +33,10 @@
 
 logger = logging.getLogger(__name__)
 
-boolean_document_based = {'u_mass'}
-sliding_window_based = {'c_v', 'c_uci', 'c_npmi'}
-_make_pipeline = namedtuple('Coherence_Measure', 'seg, prob, conf, aggr')
+BOOLEAN_DOCUMENT_BASED = {'u_mass'}
+SLIDING_WINDOW_BASED = {'c_v', 'c_uci', 'c_npmi', 'c_w2v'}
 
+_make_pipeline = namedtuple('Coherence_Measure', 'seg, prob, conf, aggr')
 COHERENCE_MEASURES = {
     'u_mass': _make_pipeline(
         segmentation.s_one_pre,
@@ -51,6 +50,12 @@
         indirect_confirmation_measure.cosine_similarity,
         aggregation.arithmetic_mean
     ),
+    'c_w2v': _make_pipeline(
+        segmentation.s_one_set,
+        probability_estimation.p_word2vec,
+        indirect_confirmation_measure.word2vec_similarity,
+        aggregation.arithmetic_mean
+    ),
     'c_uci': _make_pipeline(
         segmentation.s_one_one,
         probability_estimation.p_boolean_sliding_window,
@@ -67,8 +72,10 @@
 
 SLIDING_WINDOW_SIZES = {
     'c_v': 110,
+    'c_w2v': 5,
     'c_uci': 10,
-    'c_npmi': 10
+    'c_npmi': 10,
+    'u_mass': None
 }
 
 
@@ -109,7 +116,7 @@ class CoherenceModel(interfaces.TransformationABC):
     Model persistency is achieved via its load/save methods.
     """
     def __init__(self, model=None, topics=None, texts=None, corpus=None, dictionary=None,
-                 window_size=None, coherence='c_v', topn=10, processes=-1):
+                 window_size=None, keyed_vectors=None, coherence='c_v', topn=20, processes=-1):
         """
         Args:
             model : Pre-trained topic model. Should be provided if topics is not provided.
@@ -151,15 +158,16 @@ def __init__(self, model=None, topics=None, texts=None, corpus=None, dictionary=
                 to corpus using the dictionary. For 'c_v', 'c_uci' and 'c_npmi' texts should be provided.
                 Corpus is not needed.
             topn : Integer corresponding to the number of top words to be extracted from each topic.
-            processes : number of processes to use for probability estimation phase; any value less than 1 will be
-                interpreted to mean num_cpus - 1; default is -1.
+            processes : number of processes to use for probability estimation phase; any value
+                less than 1 will be interpreted to mean num_cpus - 1; default is -1.
         """
         if model is None and topics is None:
             raise ValueError("One of model or topics has to be provided.")
         elif topics is not None and dictionary is None:
             raise ValueError("dictionary has to be provided if topics are to be used.")
 
-        if texts is None and corpus is None:
+        self.keyed_vectors = keyed_vectors
+        if keyed_vectors is None and texts is None and corpus is None:
             raise ValueError("One of texts or corpus has to be provided.")
 
         # Check if associated dictionary is provided.
@@ -175,30 +183,32 @@ def __init__(self, model=None, topics=None, texts=None, corpus=None, dictionary=
 
         # Check for correct inputs for u_mass coherence measure.
         self.coherence = coherence
-        if coherence in boolean_document_based:
+        self.window_size = window_size
+        if self.window_size is None:
+            self.window_size = SLIDING_WINDOW_SIZES[self.coherence]
+        self.texts = texts
+        self.corpus = corpus
+
+        if coherence in BOOLEAN_DOCUMENT_BASED:
             if is_corpus(corpus)[0]:
                 self.corpus = corpus
-            elif texts is not None:
-                self.texts = texts
+            elif self.texts is not None:
                 self.corpus = [self.dictionary.doc2bow(text) for text in self.texts]
             else:
                 raise ValueError(
                     "Either 'corpus' with 'dictionary' or 'texts' should "
                     "be provided for %s coherence.", coherence)
 
-        # Check for correct inputs for c_v coherence measure.
-        elif coherence in sliding_window_based:
-            self.window_size = window_size
-            if self.window_size is None:
-                self.window_size = SLIDING_WINDOW_SIZES[self.coherence]
-            if texts is None:
+        # Check for correct inputs for sliding window coherence measure.
+        elif coherence == 'c_w2v' and keyed_vectors is not None:
+            pass
+        elif coherence in SLIDING_WINDOW_BASED:
+            if self.texts is None:
                 raise ValueError("'texts' should be provided for %s coherence.", coherence)
-            else:
-                self.texts = texts
         else:
             raise ValueError("%s coherence is not currently supported.", coherence)
 
-        self.topn = topn
+        self._topn = topn
         self._model = model
         self._accumulator = None
         self._topics = None
@@ -206,6 +216,66 @@ def __init__(self, model=None, topics=None, texts=None, corpus=None, dictionary=
 
         self.processes = processes if processes > 1 else max(1, mp.cpu_count() - 1)
 
+    @classmethod
+    def for_models(cls, models, dictionary, topn=20, **kwargs):
+        """Initialize a CoherenceModel with estimated probabilities for all of the given models.
+
+        Args:
+            models (list): List of models to evalaute coherence of; the only requirement is
+                that each has a `get_topics` methods.
+        """
+        topics = [cls.top_topics_as_word_lists(model, dictionary, topn) for model in models]
+        kwargs['dictionary'] = dictionary
+        kwargs['topn'] = topn
+        return cls.for_topics(topics, **kwargs)
+
+    @staticmethod
+    def top_topics_as_word_lists(model, dictionary, topn=20):
+        if not dictionary.id2token:
+            dictionary.id2token = {v: k for k, v in dictionary.token2id.items()}
+
+        str_topics = []
+        for topic in model.get_topics():
+            bestn = matutils.argsort(topic, topn=topn, reverse=True)
+            beststr = [dictionary.id2token[_id] for _id in bestn]
+            str_topics.append(beststr)
+        return str_topics
+
+    @classmethod
+    def for_topics(cls, topics_as_topn_terms, **kwargs):
+        """Initialize a CoherenceModel with estimated probabilities for all of the given topics.
+
+        Args:
+            topics_as_topn_terms (list of lists): Each element in the top-level list should be
+                the list of topics for a model. The topics for the model should be a list of
+                top-N words, one per topic.
+        """
+        if not topics_as_topn_terms:
+            raise ValueError("len(topics) must be > 0.")
+        if any(len(topic_lists) == 0 for topic_lists in topics_as_topn_terms):
+            raise ValueError("found empty topic listing in `topics`")
+
+        topn = 0
+        for topic_list in topics_as_topn_terms:
+            for topic in topic_list:
+                topn = max(topn, len(topic))
+
+        if 'topn' in kwargs:
+            topn = min(kwargs.get('topn'), topn)
+            del kwargs['topn']
+
+        super_topic = set()
+        for topic in topics_as_topn_terms:
+            super_topic.update(itertools.chain.from_iterable(topic))
+
+        logging.info(
+            "Number of relevant terms for all %d models: %d",
+            len(topics_as_topn_terms), len(super_topic))
+        cm = CoherenceModel(topics=[super_topic], topn=len(super_topic), **kwargs)
+        cm.estimate_probabilities()
+        cm.topn = topn
+        return cm
+
     def __str__(self):
         return str(self.measure)
 
@@ -221,32 +291,63 @@ def model(self, model):
             self._update_accumulator(new_topics)
             self._topics = new_topics
 
+    @property
+    def topn(self):
+        return self._topn
+
+    @topn.setter
+    def topn(self, topn):
+        current_topic_length = len(self._topics[0])
+        requires_expansion = current_topic_length < topn
+
+        if self.model is not None:
+            self._topn = topn
+            if requires_expansion:
+                self.model = self._model  # trigger topic expansion from model
+        else:
+            if requires_expansion:
+                raise ValueError("Model unavailable and topic sizes are less than topn=%d" % topn)
+            self._topn = topn  # topics will be truncated in getter
+
     @property
     def measure(self):
         return COHERENCE_MEASURES[self.coherence]
 
     @property
     def topics(self):
-        return self._topics
+        if len(self._topics[0]) > self._topn:
+            return [topic[:self._topn] for topic in self._topics]
+        else:
+            return self._topics
 
     @topics.setter
     def topics(self, topics):
-        new_topics = None
-        if self.model is not None:
-            new_topics = self._get_topics()
-            if topics is not None:
-                logger.warning(
-                    "Ignoring topics you are attempting to set in favor of model's topics: %s",
-                    self.model)
-        elif topics is not None:
+        if topics is not None:
             new_topics = []
             for topic in topics:
-                topic_token_ids = np.array([self.dictionary.token2id[token] for token in topic])
+                topic_token_ids = self._ensure_elements_are_ids(topic)
                 new_topics.append(topic_token_ids)
 
+            if self.model is not None:
+                logger.warning(
+                    "The currently set model '%s' may be inconsistent with the newly set topics",
+                    self.model)
+        elif self.model is not None:
+            new_topics = self._get_topics()
+            logger.debug("Setting topics to those of the model: %s", self.model)
+        else:
+            new_topics = None
+
         self._update_accumulator(new_topics)
         self._topics = new_topics
 
+    def _ensure_elements_are_ids(self, topic):
+        try:
+            return np.array([self.dictionary.token2id[token] for token in topic])
+        except KeyError:  # might be a list of token ids already, but let's verify all in dict
+            topic = [self.dictionary.id2token[_id] for _id in topic]
+            return np.array([self.dictionary.token2id[token] for token in topic])
+
     def _update_accumulator(self, new_topics):
         if self._relevant_ids_will_differ(new_topics):
             logger.debug("Wiping cached accumulator since it does not contain all relevant ids.")
@@ -265,11 +366,16 @@ def _topics_differ(self, new_topics):
                 not np.array_equal(new_topics, self._topics))
 
     def _get_topics(self):
+        """Internal helper function to return topics from a trained topic model."""
+        return self._get_topics_from_model(self.model, self.topn)
+
+    @staticmethod
+    def _get_topics_from_model(model, topn):
         """Internal helper function to return topics from a trained topic model."""
         try:
             return [
-                argsort(topic, topn=self.topn, reverse=True) for topic in
-                self.model.get_topics()
+                matutils.argsort(topic, topn=topn, reverse=True) for topic in
+                model.get_topics()
             ]
         except AttributeError:
             raise ValueError(
@@ -287,17 +393,21 @@ def estimate_probabilities(self, segmented_topics=None):
         if segmented_topics is None:
             segmented_topics = self.segment_topics()
 
-        if self.coherence in boolean_document_based:
+        if self.coherence in BOOLEAN_DOCUMENT_BASED:
             self._accumulator = self.measure.prob(self.corpus, segmented_topics)
         else:
-            self._accumulator = self.measure.prob(
+            kwargs = dict(
                 texts=self.texts, segmented_topics=segmented_topics,
                 dictionary=self.dictionary, window_size=self.window_size,
                 processes=self.processes)
+            if self.coherence == 'c_w2v':
+                kwargs['model'] = self.keyed_vectors
+
+            self._accumulator = self.measure.prob(**kwargs)
 
         return self._accumulator
 
-    def get_coherence_per_topic(self, segmented_topics=None):
+    def get_coherence_per_topic(self, segmented_topics=None, with_std=False):
         """Return list of coherence values for each topic based on pipeline parameters."""
         measure = self.measure
         if segmented_topics is None:
@@ -305,12 +415,12 @@ def get_coherence_per_topic(self, segmented_topics=None):
         if self._accumulator is None:
             self.estimate_probabilities(segmented_topics)
 
-        if self.coherence in boolean_document_based:
-            kwargs = {}
+        if self.coherence in BOOLEAN_DOCUMENT_BASED or self.coherence == 'c_w2v':
+            kwargs = dict(with_std=with_std)
         elif self.coherence == 'c_v':
-            kwargs = dict(topics=self.topics, measure='nlr', gamma=1)
+            kwargs = dict(topics=self.topics, measure='nlr', gamma=1, with_std=with_std)
         else:
-            kwargs = dict(normalize=(self.coherence == 'c_npmi'))
+            kwargs = dict(normalize=(self.coherence == 'c_npmi'), with_std=with_std)
 
         return measure.conf(segmented_topics, self._accumulator, **kwargs)
 
@@ -324,3 +434,62 @@ def get_coherence(self):
         """Return coherence value based on pipeline parameters."""
         confirmed_measures = self.get_coherence_per_topic()
         return self.aggregate_measures(confirmed_measures)
+
+    def compare_models(self, models):
+        model_topics = [self._get_topics_from_model(model, self.topn) for model in models]
+        return self.compare_model_topics(model_topics)
+
+    def compare_model_topics(self, model_topics):
+        """Perform the coherence evaluation for each of the models.
+
+        This first precomputes the probabilities once, then evaluates coherence for
+        each model.
+
+        Since we have already precomputed the probabilities, this simply
+        involves using the accumulated stats in the `CoherenceModel` to
+        perform the evaluations, which should be pretty quick.
+
+        Args:
+            model_topics (list): of lists of top-N words for the model trained with that
+                number of topics.
+
+        Returns:
+            list: of `(avg_topic_coherences, avg_coherence)`.
+                These are the coherence values per topic and the overall model coherence.
+        """
+        orig_topics = self._topics
+        orig_topn = self.topn
+
+        try:
+            coherences = self._compare_model_topics(model_topics)
+        finally:
+            self.topics = orig_topics
+            self.topn = orig_topn
+
+        return coherences
+
+    def _compare_model_topics(self, model_topics):
+        coherences = []
+        last_topn_value = min(self.topn - 1, 4)
+        topn_grid = list(range(self.topn, last_topn_value, -5))
+
+        for model_num, topics in enumerate(model_topics):
+            self.topics = topics
+
+            # We evaluate at various values of N and average them. This is a more robust,
+            # according to: http://people.eng.unimelb.edu.au/tbaldwin/pubs/naacl2016.pdf
+            coherence_at_n = {}
+            for n in topn_grid:
+                self.topn = n
+                topic_coherences = self.get_coherence_per_topic()
+
+                # Let's record the coherences for each topic, as well as the aggregated
+                # coherence across all of the topics.
+                coherence_at_n[n] = (topic_coherences, self.aggregate_measures(topic_coherences))
+
+            topic_coherences, avg_coherences = zip(*coherence_at_n.values())
+            avg_topic_coherences = np.vstack(topic_coherences).mean(0)
+            avg_coherence = np.mean(avg_coherences)
+            logging.info("Avg coherence for model %d: %.5f" % (model_num, avg_coherence))
+            coherences.append((avg_topic_coherences, avg_coherence))
+        return coherences
diff --git a/gensim/models/ldamodel.py b/gensim/models/ldamodel.py
index 55ce334460..17b6756085 100755
--- a/gensim/models/ldamodel.py
+++ b/gensim/models/ldamodel.py
@@ -33,7 +33,6 @@
 import logging
 import numbers
 import os
-from random import sample
 
 import numpy as np
 import six
diff --git a/gensim/test/test_coherencemodel.py b/gensim/test/test_coherencemodel.py
index 039db55a48..6ad8fb8f90 100644
--- a/gensim/test/test_coherencemodel.py
+++ b/gensim/test/test_coherencemodel.py
@@ -12,12 +12,13 @@
 import os
 import tempfile
 import unittest
+from unittest import SkipTest
 
 import numpy as np
 
 from gensim.corpora.dictionary import Dictionary
 from gensim.matutils import argsort
-from gensim.models.coherencemodel import CoherenceModel, boolean_document_based
+from gensim.models.coherencemodel import CoherenceModel, BOOLEAN_DOCUMENT_BASED
 from gensim.models.ldamodel import LdaModel
 from gensim.models.wrappers import LdaMallet
 from gensim.models.wrappers import LdaVowpalWabbit
@@ -82,7 +83,7 @@ def setUp(self):
 
     def check_coherence_measure(self, coherence):
         """Check provided topic coherence algorithm on given topics"""
-        if coherence in boolean_document_based:
+        if coherence in BOOLEAN_DOCUMENT_BASED:
             kwargs = dict(corpus=self.corpus, dictionary=self.dictionary, coherence=coherence)
         else:
             kwargs = dict(texts=self.texts, dictionary=self.dictionary, coherence=coherence)
@@ -118,6 +119,10 @@ def testCvLdaModel(self):
         """Perform sanity check to see if c_v coherence works with LDA Model"""
         CoherenceModel(model=self.ldamodel, texts=self.texts, coherence='c_v')
 
+    def testCw2vLdaModel(self):
+        """Perform sanity check to see if c_w2v coherence works with LDAModel."""
+        CoherenceModel(model=self.ldamodel, texts=self.texts, coherence='c_w2v')
+
     def testCuciLdaModel(self):
         """Perform sanity check to see if c_uci coherence works with LDA Model"""
         CoherenceModel(model=self.ldamodel, texts=self.texts, coherence='c_uci')
@@ -128,50 +133,60 @@ def testCnpmiLdaModel(self):
 
     def testUMassMalletModel(self):
         """Perform sanity check to see if u_mass coherence works with LDA Mallet gensim wrapper"""
-        if not self.mallet_path:
-            return
+        self._check_for_mallet()
         CoherenceModel(model=self.malletmodel, corpus=self.corpus, coherence='u_mass')
 
+    def _check_for_mallet(self):
+        if not self.mallet_path:
+            raise SkipTest("Mallet not installed")
+
     def testCvMalletModel(self):
         """Perform sanity check to see if c_v coherence works with LDA Mallet gensim wrapper"""
-        if not self.mallet_path:
-            return
+        self._check_for_mallet()
         CoherenceModel(model=self.malletmodel, texts=self.texts, coherence='c_v')
 
+    def testCw2vMalletModel(self):
+        """Perform sanity check to see if c_w2v coherence works with LDA Mallet gensim wrapper"""
+        self._check_for_mallet()
+        CoherenceModel(model=self.malletmodel, texts=self.texts, coherence='c_w2v')
+
     def testCuciMalletModel(self):
         """Perform sanity check to see if c_uci coherence works with LDA Mallet gensim wrapper"""
-        if not self.mallet_path:
-            return
+        self._check_for_mallet()
         CoherenceModel(model=self.malletmodel, texts=self.texts, coherence='c_uci')
 
     def testCnpmiMalletModel(self):
         """Perform sanity check to see if c_npmi coherence works with LDA Mallet gensim wrapper"""
-        if not self.mallet_path:
-            return
+        self._check_for_mallet()
         CoherenceModel(model=self.malletmodel, texts=self.texts, coherence='c_npmi')
 
     def testUMassVWModel(self):
         """Perform sanity check to see if u_mass coherence works with LDA VW gensim wrapper"""
-        if not self.vw_path:
-            return
+        self._check_for_vw()
         CoherenceModel(model=self.vwmodel, corpus=self.corpus, coherence='u_mass')
 
+    def _check_for_vw(self):
+        if not self.vw_path:
+            raise SkipTest("Vowpal Wabbit not installed")
+
     def testCvVWModel(self):
         """Perform sanity check to see if c_v coherence works with LDA VW gensim wrapper"""
-        if not self.vw_path:
-            return
+        self._check_for_vw()
         CoherenceModel(model=self.vwmodel, texts=self.texts, coherence='c_v')
 
+    def testCw2vVWModel(self):
+        """Perform sanity check to see if c_w2v coherence works with LDA VW gensim wrapper"""
+        self._check_for_vw()
+        CoherenceModel(model=self.vwmodel, texts=self.texts, coherence='c_w2v')
+
     def testCuciVWModel(self):
         """Perform sanity check to see if c_uci coherence works with LDA VW gensim wrapper"""
-        if not self.vw_path:
-            return
+        self._check_for_vw()
         CoherenceModel(model=self.vwmodel, texts=self.texts, coherence='c_uci')
 
     def testCnpmiVWModel(self):
         """Perform sanity check to see if c_npmi coherence works with LDA VW gensim wrapper"""
-        if not self.vw_path:
-            return
+        self._check_for_vw()
         CoherenceModel(model=self.vwmodel, texts=self.texts, coherence='c_npmi')
 
     def testErrors(self):
@@ -260,6 +275,81 @@ def testAccumulatorCachingWithModelSetting(self):
         self.assertTrue(np.array_equal(topics, cm1.topics))
         self.assertIsNone(cm1._accumulator)
 
+    def testAccumulatorCachingWithTopnSettingGivenTopics(self):
+        kwargs = dict(corpus=self.corpus, dictionary=self.dictionary, topn=5, coherence='u_mass')
+        cm1 = CoherenceModel(topics=self.topics1, **kwargs)
+        cm1.estimate_probabilities()
+        self.assertIsNotNone(cm1._accumulator)
+
+        accumulator = cm1._accumulator
+        topics_before = cm1._topics
+        cm1.topn = 3
+        self.assertEqual(accumulator, cm1._accumulator)
+        self.assertEqual(3, len(cm1.topics[0]))
+        self.assertEqual(topics_before, cm1._topics)
+
+        # Topics should not have been truncated, so topn settings below 5 should work
+        cm1.topn = 4
+        self.assertEqual(accumulator, cm1._accumulator)
+        self.assertEqual(4, len(cm1.topics[0]))
+        self.assertEqual(topics_before, cm1._topics)
+
+        with self.assertRaises(ValueError):
+            cm1.topn = 6  # can't expand topics any further without model
+
+    def testAccumulatorCachingWithTopnSettingGivenModel(self):
+        kwargs = dict(corpus=self.corpus, dictionary=self.dictionary, topn=5, coherence='u_mass')
+        cm1 = CoherenceModel(model=self.ldamodel, **kwargs)
+        cm1.estimate_probabilities()
+        self.assertIsNotNone(cm1._accumulator)
+
+        accumulator = cm1._accumulator
+        topics_before = cm1._topics
+        cm1.topn = 3
+        self.assertEqual(accumulator, cm1._accumulator)
+        self.assertEqual(3, len(cm1.topics[0]))
+        self.assertEqual(topics_before, cm1._topics)
+
+        cm1.topn = 6  # should be able to expand given the model
+        self.assertIsNone(cm1._accumulator)  # should uncache due to missing terms in accumulator
+        self.assertEqual(6, len(cm1.topics[0]))
+
+    def testCompareCoherenceForTopics(self):
+        topics = [self.topics1, self.topics2]
+        cm = CoherenceModel.for_topics(
+            topics, dictionary=self.dictionary, texts=self.texts, coherence='c_v')
+        self.assertIsNotNone(cm._accumulator)
+
+        # Accumulator should have all relevant IDs.
+        for topic_list in topics:
+            cm.topics = topic_list
+            self.assertIsNotNone(cm._accumulator)
+
+        (coherence_topics1, coherence1), (coherence_topics2, coherence2) = \
+            cm.compare_model_topics(topics)
+
+        self.assertAlmostEqual(np.mean(coherence_topics1), coherence1, 4)
+        self.assertAlmostEqual(np.mean(coherence_topics2), coherence2, 4)
+        self.assertGreater(coherence1, coherence2)
+
+    def testCompareCoherenceForModels(self):
+        models = [self.ldamodel, self.ldamodel]
+        cm = CoherenceModel.for_models(
+            models, dictionary=self.dictionary, texts=self.texts, coherence='c_v')
+        self.assertIsNotNone(cm._accumulator)
+
+        # Accumulator should have all relevant IDs.
+        for model in models:
+            cm.model = model
+            self.assertIsNotNone(cm._accumulator)
+
+        (coherence_topics1, coherence1), (coherence_topics2, coherence2) = \
+            cm.compare_models(models)
+
+        self.assertAlmostEqual(np.mean(coherence_topics1), coherence1, 4)
+        self.assertAlmostEqual(np.mean(coherence_topics2), coherence2, 4)
+        self.assertAlmostEqual(coherence1, coherence2, places=4)
+
 
 if __name__ == '__main__':
     logging.basicConfig(format='%(asctime)s : %(levelname)s : %(message)s', level=logging.DEBUG)
diff --git a/gensim/test/test_direct_confirmation.py b/gensim/test/test_direct_confirmation.py
index 1d4f701cc9..170aa7288a 100644
--- a/gensim/test/test_direct_confirmation.py
+++ b/gensim/test/test_direct_confirmation.py
@@ -37,7 +37,12 @@ def testLogConditionalProbability(self):
             self.segmentation, self.accumulator)[0]
         # Answer should be ~ ln(1 / 2) = -0.693147181
         expected = -0.693147181
-        self.assertAlmostEqual(obtained, expected)
+        self.assertAlmostEqual(expected, obtained)
+
+        mean, std = direct_confirmation_measure.log_conditional_probability(
+            self.segmentation, self.accumulator, with_std=True)[0]
+        self.assertAlmostEqual(expected, mean)
+        self.assertEqual(0.0, std)
 
     def testLogRatioMeasure(self):
         """Test log_ratio_measure()"""
@@ -45,7 +50,12 @@ def testLogRatioMeasure(self):
             self.segmentation, self.accumulator)[0]
         # Answer should be ~ ln{(1 / 5) / [(3 / 5) * (2 / 5)]} = -0.182321557
         expected = -0.182321557
-        self.assertAlmostEqual(obtained, expected)
+        self.assertAlmostEqual(expected, obtained)
+
+        mean, std = direct_confirmation_measure.log_ratio_measure(
+            self.segmentation, self.accumulator, with_std=True)[0]
+        self.assertAlmostEqual(expected, mean)
+        self.assertEqual(0.0, std)
 
     def testNormalizedLogRatioMeasure(self):
         """Test normalized_log_ratio_measure()"""
@@ -53,7 +63,12 @@ def testNormalizedLogRatioMeasure(self):
             self.segmentation, self.accumulator, normalize=True)[0]
         # Answer should be ~ -0.182321557 / -ln(1 / 5) = -0.113282753
         expected = -0.113282753
-        self.assertAlmostEqual(obtained, expected)
+        self.assertAlmostEqual(expected, obtained)
+
+        mean, std = direct_confirmation_measure.log_ratio_measure(
+            self.segmentation, self.accumulator, normalize=True, with_std=True)[0]
+        self.assertAlmostEqual(expected, mean)
+        self.assertEqual(0.0, std)
 
 
 if __name__ == '__main__':
diff --git a/gensim/test/test_indirect_confirmation.py b/gensim/test/test_indirect_confirmation.py
index e78d32ac58..007e35a50b 100644
--- a/gensim/test/test_indirect_confirmation.py
+++ b/gensim/test/test_indirect_confirmation.py
@@ -28,16 +28,16 @@ def setUp(self):
         self.gamma = 1
         self.measure = 'nlr'
 
-        dictionary = Dictionary()
-        dictionary.id2token = {1: 'fake', 2: 'tokens'}
-        self.accumulator = text_analysis.InvertedIndexAccumulator({1, 2}, dictionary)
-        self.accumulator._inverted_index = {0: {2, 3, 4}, 1: {3, 5}}
-        self.accumulator._num_docs = 5
+        self.dictionary = Dictionary()
+        self.dictionary.id2token = {1: 'fake', 2: 'tokens'}
 
     def testCosineSimilarity(self):
         """Test cosine_similarity()"""
+        accumulator = text_analysis.InvertedIndexAccumulator({1, 2}, self.dictionary)
+        accumulator._inverted_index = {0: {2, 3, 4}, 1: {3, 5}}
+        accumulator._num_docs = 5
         obtained = indirect_confirmation_measure.cosine_similarity(
-            self.segmentation, self.accumulator, self.topics, self.measure, self.gamma)
+            self.segmentation, accumulator, self.topics, self.measure, self.gamma)
 
         # The steps involved in this calculation are as follows:
         # 1. Take (1, array([1, 2]). Take w' which is 1.
@@ -49,6 +49,25 @@ def testCosineSimilarity(self):
         expected = (0.6230 + 0.6230) / 2.  # To account for EPSILON approximation
         self.assertAlmostEqual(expected, obtained[0], 4)
 
+        mean, std = indirect_confirmation_measure.cosine_similarity(
+            self.segmentation, accumulator, self.topics, self.measure, self.gamma,
+            with_std=True)[0]
+        self.assertAlmostEqual(expected, mean, 4)
+        self.assertAlmostEqual(0.0, std, 1)
+
+    def testWord2VecSimilarity(self):
+        """Sanity check word2vec_similarity."""
+        accumulator = text_analysis.WordVectorsAccumulator({1, 2}, self.dictionary)
+        accumulator.accumulate([
+            ['fake', 'tokens'],
+            ['tokens', 'fake']
+        ], 5)
+
+        mean, std = indirect_confirmation_measure.word2vec_similarity(
+            self.segmentation, accumulator, with_std=True)[0]
+        self.assertNotEqual(0.0, mean)
+        self.assertNotEqual(0.0, std)
+
 
 if __name__ == '__main__':
     logging.root.setLevel(logging.WARNING)
diff --git a/gensim/test/test_text_analysis.py b/gensim/test/test_text_analysis.py
index e6f4aba86b..93f00ae3a8 100644
--- a/gensim/test/test_text_analysis.py
+++ b/gensim/test/test_text_analysis.py
@@ -2,9 +2,9 @@
 import unittest
 
 from gensim.corpora.dictionary import Dictionary
-from gensim.topic_coherence.text_analysis import \
-    InvertedIndexAccumulator, WordOccurrenceAccumulator, ParallelWordOccurrenceAccumulator, \
-    CorpusAccumulator
+from gensim.topic_coherence.text_analysis import (
+    InvertedIndexAccumulator, WordOccurrenceAccumulator, ParallelWordOccurrenceAccumulator,
+    CorpusAccumulator)
 
 
 class BaseTestCases(object):
diff --git a/gensim/topic_coherence/direct_confirmation_measure.py b/gensim/topic_coherence/direct_confirmation_measure.py
index 247d8c146d..4b4d079655 100644
--- a/gensim/topic_coherence/direct_confirmation_measure.py
+++ b/gensim/topic_coherence/direct_confirmation_measure.py
@@ -17,16 +17,18 @@
 EPSILON = 1e-12  # Should be small. Value as suggested in paper.
 
 
-def log_conditional_probability(segmented_topics, accumulator):
+def log_conditional_probability(segmented_topics, accumulator, with_std=False):
     """
     This function calculates the log-conditional-probability measure
     which is used by coherence measures such as U_mass.
     This is defined as: m_lc(S_i) = log[(P(W', W*) + e) / P(W*)]
 
     Args:
-        segmented_topics : Output from the segmentation module of the segmented topics.
+        segmented_topics: Output from the segmentation module of the segmented topics.
             Is a list of list of tuples.
         accumulator: word occurrence accumulator from probability_estimation.
+        with_std (bool): True to also include standard deviation across topic segment
+            sets in addition to the mean coherence for each topic; default is False.
 
     Returns:
         m_lc : List of log conditional probability measure for each topic.
@@ -36,20 +38,24 @@ def log_conditional_probability(segmented_topics, accumulator):
     for s_i in segmented_topics:
         segment_sims = []
         for w_prime, w_star in s_i:
-            w_star_count = accumulator[w_star]
-            if w_star_count == 0:
-                raise ValueError("Topic with id %d not found in corpus used to compute coherence. "
-                    "Try using a larger corpus with a smaller vocobulary and/or setting a smaller value of `topn` for `CoherenceModel`." % (w_star))
-            co_occur_count = accumulator[w_prime, w_star]
-            m_lc_i = np.log(((co_occur_count / num_docs) + EPSILON) / (w_star_count / num_docs))
+            try:
+                w_star_count = accumulator[w_star]
+                co_occur_count = accumulator[w_prime, w_star]
+                m_lc_i = np.log(((co_occur_count / num_docs) + EPSILON) / (w_star_count / num_docs))
+            except KeyError:
+                m_lc_i = 0.0
 
             segment_sims.append(m_lc_i)
-        m_lc.append(np.mean(segment_sims))
+
+        if with_std:
+            m_lc.append((np.mean(segment_sims), np.std(segment_sims)))
+        else:
+            m_lc.append(np.mean(segment_sims))
 
     return m_lc
 
 
-def log_ratio_measure(segmented_topics, accumulator, normalize=False):
+def log_ratio_measure(segmented_topics, accumulator, normalize=False, with_std=False):
     """
     If normalize=False:
         Popularly known as PMI.
@@ -66,6 +72,8 @@ def log_ratio_measure(segmented_topics, accumulator, normalize=False):
         segmented topics : Output from the segmentation module of the segmented topics.
             Is a list of list of tuples.
         accumulator: word occurrence accumulator from probability_estimation.
+        with_std (bool): True to also include standard deviation across topic segment
+            sets in addition to the mean coherence for each topic; default is False.
 
     Returns:
         m_lr : List of log ratio measures for each topic.
@@ -91,6 +99,10 @@ def log_ratio_measure(segmented_topics, accumulator, normalize=False):
                 m_lr_i = np.log(numerator / denominator)
 
             segment_sims.append(m_lr_i)
-        m_lr.append(np.mean(segment_sims))
+
+        if with_std:
+            m_lr.append((np.mean(segment_sims), np.std(segment_sims)))
+        else:
+            m_lr.append(np.mean(segment_sims))
 
     return m_lr
diff --git a/gensim/topic_coherence/indirect_confirmation_measure.py b/gensim/topic_coherence/indirect_confirmation_measure.py
index 241b96befc..33034d0c16 100644
--- a/gensim/topic_coherence/indirect_confirmation_measure.py
+++ b/gensim/topic_coherence/indirect_confirmation_measure.py
@@ -15,11 +15,13 @@
 
 The formula used to compute indirect confirmation measure is:
 
-m_{sim}_{(m, \gamma)}(W', W*) = s_{sim}(\vec{V}^{\,}_{m,\gamma}(W'), \vec{V}^{\,}_{m,\gamma}(W*))
+m_{sim}_{(m, \gamma)}(W', W*) =
+    s_{sim}(\vec{V}^{\,}_{m,\gamma}(W'), \vec{V}^{\,}_{m,\gamma}(W*))
 
 where s_sim can be cosine, dice or jaccard similarity and
 
-\vec{V}^{\,}_{m,\gamma}(W') = \Bigg \{{\sum_{w_{i} \in W'}^{ } m(w_{i}, w_{j})^{\gamma}}\Bigg \}_{j = 1,...,|W|}
+\vec{V}^{\,}_{m,\gamma}(W') =
+    \Bigg \{{\sum_{w_{i} \in W'}^{ } m(w_{i}, w_{j})^{\gamma}}\Bigg \}_{j = 1,...,|W|}
 
 Here 'm' is the direct confirmation measure used.
 """
@@ -35,7 +37,47 @@
 logger = logging.getLogger(__name__)
 
 
-def cosine_similarity(segmented_topics, accumulator, topics, measure='nlr', gamma=1):
+def word2vec_similarity(segmented_topics, accumulator, with_std=False):
+    """For each topic segmentation, compute average cosine similarity using a
+    WordVectorsAccumulator.
+
+    Args:
+    ----
+    segmented_topics : Output from the segmentation module of the segmented topics.
+                       Is a list of list of tuples.
+    accumulator : Output from the probability_estimation module.
+                  Is an accumulator of word occurrences (see text_analysis module).
+    with_std : True to also include standard deviation across topic segment sets in addition
+               to the mean coherence for each topic; default is False.
+
+    Returns:
+    -------
+    topic_coherences : list of word2vec cosine similarities per topic.
+    """
+    topic_coherences = []
+    for i, topic_segments in enumerate(segmented_topics):
+        segment_similarities = []
+        for w_prime, w_star in topic_segments:
+            if not hasattr(w_prime, '__iter__'):
+                w_prime = [w_prime]
+            if not hasattr(w_star, '__iter__'):
+                w_star = [w_star]
+
+            try:
+                segment_similarities.append(accumulator.ids_similarity(w_prime, w_star))
+            except ZeroDivisionError:
+                logger.warn("at least one topic word not in word2vec model")
+
+        if with_std:
+            topic_coherences.append((np.mean(segment_similarities), np.std(segment_similarities)))
+        else:
+            topic_coherences.append(np.mean(segment_similarities))
+
+    return topic_coherences
+
+
+def cosine_similarity(segmented_topics, accumulator, topics, measure='nlr', gamma=1,
+                      with_std=False):
     """
     This function calculates the indirect cosine measure. Given context vectors
     u = V(W') and w = V(W*) for the word sets of a pair S_i = (W', W*) indirect
@@ -43,22 +85,27 @@ def cosine_similarity(segmented_topics, accumulator, topics, measure='nlr', gamm
 
     The formula used is:
 
-        m_{sim}_{(m, \gamma)}(W', W*) = s_{sim}(\vec{V}^{\,}_{m,\gamma}(W'), \vec{V}^{\,}_{m,\gamma}(W*))
+        m_{sim}_{(m, \gamma)}(W', W*) =
+            s_{sim}(\vec{V}^{\,}_{m,\gamma}(W'), \vec{V}^{\,}_{m,\gamma}(W*))
 
     where each vector:
 
-        \vec{V}^{\,}_{m,\gamma}(W') = \Bigg \{{\sum_{w_{i} \in W'}^{ } m(w_{i}, w_{j})^{\gamma}}\Bigg \}_{j = 1,...,|W|}
+        \vec{V}^{\,}_{m,\gamma}(W') =
+            \Bigg \{{\sum_{w_{i} \in W'}^{ } m(w_{i}, w_{j})^{\gamma}}\Bigg \}_{j = 1,...,|W|}
 
     Args:
-
-        segmented_topics : Output from the segmentation module of the segmented topics. Is a list of list of tuples.
-        accumulator : Output from the probability_estimation module. Is an accumulator of word occurrences (see text_analysis module).
+        segmented_topics : Output from the segmentation module of the segmented topics.
+            Is a list of list of tuples.
+        accumulator : Output from the probability_estimation module. Is an accumulator
+            of word occurrences (see text_analysis module).
         topics : Topics obtained from the trained topic model.
-        measure : String. Direct confirmation measure to be used. Supported values are "nlr" (normalized log ratio).
+        measure (str): Direct confirmation measure to be used. Supported values are
+            "nlr" (normalized log ratio).
         gamma : Gamma value for computing W', W* vectors; default is 1.
+        with_std (bool): True to also include standard deviation across topic segment
+            sets in addition to the mean coherence for each topic; default is False.
 
     Returns:
-
         s_cos_sim : list of indirect cosine similarity measure for each topic.
 
     """
@@ -72,7 +119,11 @@ def cosine_similarity(segmented_topics, accumulator, topics, measure='nlr', gamm
             w_prime_cv = context_vectors[w_prime, topic_words]
             w_star_cv = context_vectors[w_star, topic_words]
             segment_sims[i] = _cossim(w_prime_cv, w_star_cv)
-        s_cos_sim.append(np.mean(segment_sims))
+
+        if with_std:
+            s_cos_sim.append((np.mean(segment_sims), np.std(segment_sims)))
+        else:
+            s_cos_sim.append(np.mean(segment_sims))
 
     return s_cos_sim
 
diff --git a/gensim/topic_coherence/probability_estimation.py b/gensim/topic_coherence/probability_estimation.py
index 7832494a5c..f59692bdcc 100644
--- a/gensim/topic_coherence/probability_estimation.py
+++ b/gensim/topic_coherence/probability_estimation.py
@@ -11,8 +11,9 @@
 import itertools
 import logging
 
-from gensim.topic_coherence.text_analysis import \
-    CorpusAccumulator, WordOccurrenceAccumulator, ParallelWordOccurrenceAccumulator
+from gensim.topic_coherence.text_analysis import (
+    CorpusAccumulator, WordOccurrenceAccumulator, ParallelWordOccurrenceAccumulator,
+    WordVectorsAccumulator)
 
 logger = logging.getLogger(__name__)
 
@@ -60,6 +61,18 @@ def p_boolean_sliding_window(texts, segmented_topics, dictionary, window_size, p
     return accumulator.accumulate(texts, window_size)
 
 
+def p_word2vec(texts, segmented_topics, dictionary, window_size=None, processes=1, model=None):
+    """Train word2vec model on `texts` if model is not None.
+    Returns:
+    ----
+    accumulator: text accumulator with trained context vectors.
+    """
+    top_ids = unique_ids_from_segments(segmented_topics)
+    accumulator = WordVectorsAccumulator(
+        top_ids, dictionary, model, window=window_size, workers=processes)
+    return accumulator.accumulate(texts, window_size)
+
+
 def unique_ids_from_segments(segmented_topics):
     """Return the set of all unique ids in a list of segmented topics.
 
diff --git a/gensim/topic_coherence/text_analysis.py b/gensim/topic_coherence/text_analysis.py
index 351f15a932..f6648a76f0 100644
--- a/gensim/topic_coherence/text_analysis.py
+++ b/gensim/topic_coherence/text_analysis.py
@@ -20,6 +20,7 @@
 from six import iteritems, string_types
 
 from gensim import utils
+from gensim.models.word2vec import Word2Vec
 
 logger = logging.getLogger(__name__)
 
@@ -467,3 +468,63 @@ def reply_to_master(self):
         logger.info("serializing accumulator to return to master...")
         self.output_q.put(self.accumulator, block=False)
         logger.info("accumulator serialized")
+
+
+class WordVectorsAccumulator(UsesDictionary):
+    """Accumulate context vectors for words using word vector embeddings."""
+
+    def __init__(self, relevant_ids, dictionary, model=None, **model_kwargs):
+        """
+        Args:
+        ----
+        model: if None, a new Word2Vec model is trained on the given text corpus. If not None,
+               it should be a pre-trained Word2Vec context
+               vectors (gensim.models.keyedvectors.KeyedVectors instance).
+        model_kwargs: if model is None, these keyword arguments will be passed through to the
+                      Word2Vec constructor.
+        """
+        super(WordVectorsAccumulator, self).__init__(relevant_ids, dictionary)
+        self.model = model
+        self.model_kwargs = model_kwargs
+
+    def get_occurrences(self, word):
+        """Return number of docs the word occurs in, once `accumulate` has been called."""
+        try:
+            self.token2id[word]  # is this a token or an id?
+        except KeyError:
+            word = self.dictionary.id2token[word]
+        return self.model.vocab[word].count
+
+    def get_co_occurrences(self, word1, word2):
+        """Return number of docs the words co-occur in, once `accumulate` has been called."""
+        raise NotImplementedError("Word2Vec model does not support co-occurrence counting")
+
+    def accumulate(self, texts, window_size):
+        if self.model is not None:
+            logger.debug("model is already trained; no accumulation necessary")
+            return self
+
+        kwargs = self.model_kwargs.copy()
+        if window_size is not None:
+            kwargs['window'] = window_size
+        kwargs['min_count'] = kwargs.get('min_count', 1)
+        kwargs['sg'] = kwargs.get('sg', 1)
+        kwargs['hs'] = kwargs.get('hw', 0)
+
+        self.model = Word2Vec(**kwargs)
+        self.model.build_vocab(texts)
+        self.model.train(texts, total_examples=self.model.corpus_count, epochs=self.model.iter)
+        self.model = self.model.wv  # retain KeyedVectors
+        return self
+
+    def ids_similarity(self, ids1, ids2):
+        words1 = self._words_with_embeddings(ids1)
+        words2 = self._words_with_embeddings(ids2)
+        return self.model.n_similarity(words1, words2)
+
+    def _words_with_embeddings(self, ids):
+        if not hasattr(ids, '__iter__'):
+            ids = [ids]
+
+        words = [self.dictionary.id2token[word_id] for word_id in ids]
+        return [word for word in words if word in self.model.vocab]


Code review comments:
diff_hunk: @@ -261,6 +260,10 @@ def for_topics(cls, topics_as_topn_terms, **kwargs):
             for topic in topic_list:
                 topn = max(topn, len(topic))
 
+        if 'topn' in kwargs:
+            topn = min(kwargs.get('topn'), topn)
+            del kwargs['topn']
path: gensim/models/coherencemodel.py
text: @user1:
Have a look at `dict.pop()`.