Question: How large is the gap in performance between the HMMs and the LSTMs?
Answer: With similar number of parameters, the log likelihood is about 0.1 lower for LSTMs across datasets. When the number of parameters in LSTMs is increased, their log likelihood is up to 0.7 lower.