(trunk/babel/s5b) For the UEM segmentation, allow for use of alternative extensions of the datadir.

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3499 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Reverting the previous commit as it was including other changes not related to the subject of the commit

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3500 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Reverting the previous commit as it was including other changes not related to the subject of the commit

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3501 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Ignore the return code of the cleanup code. Othervise the 'set -e' will cause failing the script after rm returns non-zero status code

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3502 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
trunk,nnet: minor update,
* analyze-counts refactored, accepts symbol table to print counts
* nnet-loss.cc - added sanity check to dim in input posteriors



git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3503 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
Changes to lower level scripts for proxy keywords: 1. decomposed generate_proxy_keywords.sh into a language dependent part and language independent part; 2. improved the ATWV performance

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3504 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
trunk: endianess in the sphinx feature dumper, now feature files are correct


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3505 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
In the postprocessing, remove the "<hes>" tag, as per the BABEL eval documentation, 
this flag is "optionably deletable", i.e. the penalty will be incurred only for
a stray insertion, not  a stray deletion. This gives approximately 0.2% WER 
improvement on Zulu


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3506 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Bugfixes and small improvements to the G2P scripts. 
The interface is regarded stable for now.


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3507 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Adding a script for confusion matrix generation (for use, e.g. with the proxy kw search)


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3508 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(babel/trunk/s5b) Improvement to the combination. Now it better sweeps the power interval (0,1>
so we have the same resolution during the whole interval (which wasnt the case when using inv-power,
where the resolution was reciprocical )


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3509 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Adding documentation to the confusion matrix generation script


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3510 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
Fixes to extend_lexicon.sh: 1. added OOV rate computation as diagnostic information, if a text file is provided; 2. extended phone mapping repository to a..zA..Z0..9; 3. changed num_sent_gen as the total number of sentences to generate; 4. added encoding when processing words

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3511 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
(trunk/babel/s5b) Adding phoneme merging to the Zulu LimitedLP lang config. 
The merge improves WER by about 0.5 % abs and the ATWV by about 0.3 % abs


git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3512 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
trunk: compilation fix

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3513 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
Top-level script for extending the training lexicon

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3514 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
Move lexicon extension configs to common config file... this is cleaner

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3515 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
changed learning rates and final beta value for the ensemble training recipe.

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3516 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
Various improvements to proxy keywords generation, both speech-wise and performance-wise

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3518 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
trunk: for language-id setup adding an implementation of Shifted Delta Cepstra (SDC) features and corresponding unit tests.

git-svn-id: svn://svn.code.sf.net/p/kaldi/code/trunk@3519 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8