Dialog Managers

Nested
Voicekey 0.1.0
User: nsh
Date: 7/28/2008 6:06 pm
Views: 16581
Rating: 20
Voice key was recently released, it contains
 
1) the Sphinx-based voice dictation project, "Voice Keyboard" 
2) a set of helper scripts for making language models 
3) sphinx3_livesegment, which is pocketsphinx_continuous (tty-continuous.c), ported from pocketsphinx to sphinx3, except that it also listens on stdin for a small set of commands which can be used to dynamically switch the language model or change some configuration parameters 
4) a couple of language models trained on corpora capturing my own computer use (one of them contains some word frequencies and one of them contains keystroke frequencies) 
5) a set of scripts and instructions for creating and using acoustic training data 
 
Voice Keyboard has a vocabulary of about 17,000 words roughly corresponding to the vocabulary of lm_giga_20k with proper nouns removed. It supports typing individual keystroke using codewords such, for example HENRY ECHO LIMA LIMA OSCAR. It also has codewords corresponding to most movement and modifer keys, for example CONTROL LEFT ARROW. Accuracy on the keystroke codewords is decent. Accuracy on the full vocabulary is not great but not unbearable either -- I have been using Voice Keyboard to do most of my typing for the past two months. 
 
http://sourceforge.net/projects/voicekey/ 
 
See the project documentation (in the download; particularly HACKING and also the doc/ directory) for more detailed information on items 2-5.

--- (Edited on 7/28/2008 6:06 pm [GMT-0500] by nsh) ---

Re: Voicekey 0.1.0
User: paul
Date: 11/24/2008 9:01 am
Views: 166
Rating: 16

I can't build voice-keyboard (http://ftp.heanet.ie/disk1/sourceforge/v/vo/voicekey/)
I'm running ubuntu and have tried on both 8.04.1 32-bit and 8.10 64-bit, with both gcc4.2 and gcc3.3

sphinxbase-0.4 (http://superb-east.dl.sourceforge.net/sourceforge/cmusphinx/sphinxbase-0.4.tar.bz2) builds.

sphinx3-0.7 (http://internap.dl.sourceforge.net/sourceforge/cmusphinx/sphinx3-0.7.tar.gz) will configure but won't make, with this error:
 gcc -DPACKAGE_NAME=\"\" -DPACKAGE_TARNAME=\"\" -DPACKAGE_VERSION=\"\" -DPACKAGE_STRING=\"\" -DPACKAGE_BUGREPORT=\"\" -DPACKAGE=\"sphinx3\" -DVERSION=\"0.7\
" -DSTDC_HEADERS=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_SYS_STAT_H=1 -DHAVE_STDLIB_H=1 -DHAVE_STRING_H=1 -DHAVE_MEMORY_H=1 -DHAVE_STRINGS_H=1 -DHAVE_INTTYPES_H=1 -DH
AVE_STDINT_H=1 -DHAVE_UNISTD_H=1 -DSTDC_HEADERS=1 -DHAVE_MEMMOVE=1 -DHAVE_BCOPY=1 -DRETSIGTYPE=void -DHAVE_DLFCN_H=1 -I. -I. -I../../.. -I../../../include -
I../../../include -I/usr/include/sphinxbase -I/usr/local/include/sphinxbase -g -O2 -Wall -ansi -MT gs.lo -MD -MP -MF .deps/gs.Tpo -c gs.c  -fPIC -DPIC -o .l
ibs/gs.o
gs.c: In function 'gs_fread_bitvec_t':
gs.c:85: warning: passing argument 1 of 'fread' makes pointer from integer without a cast
gs.c: In function 'gs_display':
gs.c:116: warning: implicit declaration of function 'bitvec_uint32size'
gs.c:120: warning: assignment makes integer from pointer without a cast
gs.c:137: error: subscripted value is neither array nor pointer
gs.c: In function 'gs_read':
gs.c:187: warning: assignment makes integer from pointer without a cast
gs.c:210: error: invalid type argument of 'unary *'
make[3]: *** [gs.lo] Error 1
make[3]: Leaving directory `/home/paul/voicekey.bld/sphinx3/src/libs3decoder/libam'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/home/paul/voicekey.bld/sphinx3/src/libs3decoder'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/home/paul/voicekey.bld/sphinx3/src'
make: *** [all-recursive] Error 1

sphinx3-0.6.3 (http://voxel.dl.sourceforge.net/sourceforge/cmusphinx/sphinx3-0.6.3.tar.gz) builds

lm3g2dmp (http://cmusphinx.org/download/nightly/lm3g2dmp.nightly.tar.gz) will build with sphinx3-0.6.3

Sphinxtrain (http://cmusphinx.org/download/nightly/SphinxTrain.nightly.tar.gz) will build with sphinx3-0.6.3

voicekey won't build with sphinx3-0.6.3:
~/voicekey.bld/voice-keyboard$ make
gcc sphinx3_livesegment.c -I/home/paul/voickey.bld/sphinxbase/include -I/home/paul/voicekey.bld/sphinx3/include -lsphinxad -ls3decoder -lm -o sphinx3_livese
gment
sphinx3_livesegment.c:67:23: error: s3_decode.h: No such file or directory
In file included from sphinx3_livesegment.c:70:
/home/paul/voicekey.bld/sphinx3/include/ad.h:133:21: error: ad_conf.h: No such file or directory
sphinx3_livesegment.c:85: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘decoder’
sphinx3_livesegment.c:86: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
sphinx3_livesegment.c: In function ‘reset_beam’:
sphinx3_livesegment.c:111: error: ‘decoder’ undeclared (first use in this function)
sphinx3_livesegment.c:111: error: (Each undeclared identifier is reported only once
sphinx3_livesegment.c:111: error: for each function it appears in.)
sphinx3_livesegment.c:122: error: ‘srch_t’ undeclared (first use in this function)
sphinx3_livesegment.c:122: error: expected expression before ‘)’ token
sphinx3_livesegment.c: In function ‘set_cmd’:
sphinx3_livesegment.c:134: error: ‘decoder’ undeclared (first use in this function)
sphinx3_livesegment.c: In function ‘utterance_loop’:
sphinx3_livesegment.c:347: error: ‘decoder’ undeclared (first use in this function)
sphinx3_livesegment.c:361: error: ‘fe’ undeclared (first use in this function)
sphinx3_livesegment.c: In function ‘main’:
sphinx3_livesegment.c:510: error: ‘S3_DECODE_ARG_DEFS’ undeclared (first use in this function)
sphinx3_livesegment.c:510: error: too many arguments to function ‘cmd_ln_parse’
sphinx3_livesegment.c:519: error: ‘fe’ undeclared (first use in this function)
sphinx3_livesegment.c:522: error: ‘decoder’ undeclared (first use in this function)
make: *** [sphinx3_livesegment] Error 1

sphinxbase from svn (http://sphinx.subwiki.com/sphinx/index.php/Main_Page) will autogen, make and make check,
but not install (tried both python2.4 and python2.5) with this error:
writing manifest file 'SphinxBase.egg-info/SOURCES.txt'
Traceback (most recent call last):
  File "setup.py", line 58, in ?
    cmdclass = {'bogus_uninstall' : bogus_uninstall}
  File "/usr/lib/python2.4/distutils/core.py", line 149, in setup
    dist.run_commands()
  File "/usr/lib/python2.4/distutils/dist.py", line 946, in run_commands
    self.run_command(cmd)
  File "/usr/lib/python2.4/distutils/dist.py", line 966, in run_command
    cmd_obj.run()
  File "/usr/lib/python2.4/site-packages/setuptools/command/install.py", line 76, in run
    self.do_egg_install()
  File "/usr/lib/python2.4/site-packages/setuptools/command/install.py", line 96, in do_egg_install
    self.run_command('bdist_egg')
  File "/usr/lib/python2.4/distutils/cmd.py", line 333, in run_command
    self.distribution.run_command(command)
  File "/usr/lib/python2.4/distutils/dist.py", line 966, in run_command
    cmd_obj.run()
  File "/usr/lib/python2.4/site-packages/setuptools/command/bdist_egg.py", line 167, in run
    self.run_command("egg_info")
  File "/usr/lib/python2.4/distutils/cmd.py", line 333, in run_command
    self.distribution.run_command(command)
  File "/usr/lib/python2.4/distutils/dist.py", line 966, in run_command
    cmd_obj.run()
  File "/usr/lib/python2.4/site-packages/setuptools/command/egg_info.py", line 171, in run
    self.find_sources()
  File "/usr/lib/python2.4/site-packages/setuptools/command/egg_info.py", line 252, in find_sources
    mm.run()
  File "/usr/lib/python2.4/site-packages/setuptools/command/egg_info.py", line 306, in run
    self.add_defaults()
  File "/usr/lib/python2.4/site-packages/setuptools/command/egg_info.py", line 333, in add_defaults
    rcfiles = list(walk_revctrl())
  File "/usr/lib/python2.4/site-packages/setuptools/command/sdist.py", line 45, in walk_revctrl
    for item in ep.load()(dirname):
  File "/usr/lib/python2.4/site-packages/setuptools/command/sdist.py", line 52, in _default_revctrl
    for path in finder(dirname,path):
  File "/usr/lib/python2.4/site-packages/setuptools/command/sdist.py", line 98, in entries_finder
    log.warn("unrecognized .svn/entries format in %s", dirname)
NameError: global name 'log' is not defined
make[2]: *** [install-exec-local] Error 1
make[2]: Leaving directory `/home/paul/voicekey.bld/sphinxbase/python'
make[1]: *** [install-am] Error 2
make[1]: Leaving directory `/home/paul/voicekey.bld/sphinxbase/python'
make: *** [install-recursive] Error 1

I can't get any further.  Ideas?

--- (Edited on 11/24/2008 9:01 am [GMT-0600] by Visitor) ---

Re: Voicekey 0.1.0
User: nsh
Date: 11/24/2008 12:37 pm
Views: 295
Rating: 14

> gs.c:187: warning: assignment makes integer from pointer without a cast
gs.c:210: error: invalid type argument of 'unary *'
make[3]: *** [gs.lo] Error 1

sphinx3-0.7 requires sphinxbase 0.3, also make sure you don'thave any other version installed.

>   log.warn("unrecognized .svn/entries format in %s", dirname) NameError: global name 'log' is not defined

This is the Python bug, check this and downgrade:

http://mail.python.org/pipermail/distutils-sig/2008-September/009954.html

--- (Edited on 11/24/2008 12:37 pm [GMT-0600] by nsh) ---

Re: Voicekey 0.1.0
User: Visitor
Date: 11/24/2008 9:48 pm
Views: 163
Rating: 14

It seems like sphinxbase-0.3, sphinx3-0.7, lm3g2dmp, SphinxTrain make install without errors, and the python error did not appear this time.  When I attempt to make voice-keyboard, I still get his error:

~/voicekey.bld/voice-keyboard$ make
gcc sphinx3_livesegment.c -I/home/paul/voicekey.bld/sphinxbase/include -I/home/paul/voicekey.bld/sphinx3/include -lsphinxad -ls3decoder -lm -o sphinx3_livesegment
/tmp/ccwx9sw5.o: In function `set_cmd':
sphinx3_livesegment.c:(.text+0x21b): undefined reference to `cmd_ln_set_float64'
sphinx3_livesegment.c:(.text+0x259): undefined reference to `cmd_ln_set_float64'
sphinx3_livesegment.c:(.text+0x297): undefined reference to `cmd_ln_set_float64'
sphinx3_livesegment.c:(.text+0x2d5): undefined reference to `cmd_ln_set_float64'
sphinx3_livesegment.c:(.text+0x313): undefined reference to `cmd_ln_set_float64'
/tmp/ccwx9sw5.o:sphinx3_livesegment.c:(.text+0x351): more undefined references to `cmd_ln_set_float64' follow
/tmp/ccwx9sw5.o: In function `set_cmd':
sphinx3_livesegment.c:(.text+0x388): undefined reference to `cmd_ln_set_int32'
sphinx3_livesegment.c:(.text+0x3bf): undefined reference to `cmd_ln_set_int32'
sphinx3_livesegment.c:(.text+0x3f6): undefined reference to `cmd_ln_set_int32'
sphinx3_livesegment.c:(.text+0x42a): undefined reference to `cmd_ln_set_int32'
/tmp/ccwx9sw5.o: In function `utterance_loop':
sphinx3_livesegment.c:(.text+0xb11): undefined reference to `fe_process_utt'
sphinx3_livesegment.c:(.text+0xc5f): undefined reference to `fe_process_utt'
/tmp/ccwx9sw5.o: In function `main':
sphinx3_livesegment.c:(.text+0xe54): undefined reference to `fe_init_auto'
sphinx3_livesegment.c:(.text+0xf73): undefined reference to `fe_close'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_init'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_s2mfc2feat'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_s2mfc2feat_block'
/usr/local/lib/libs3decoder.so: undefined reference to `cmn_type_from_str'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_free'
/usr/local/lib/libs3decoder.so: undefined reference to `agc_type_from_str'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_read_lda'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_array_alloc'
/usr/local/lib/libs3decoder.so: undefined reference to `feat_report'
collect2: ld returned 1 exit status
make: *** [sphinx3_livesegment] Error 1

fwiw, my gcc is 4.2.

Any ideas?

 

--- (Edited on 11/24/2008 9:48 pm [GMT-0600] by Visitor) ---

Re: Voicekey 0.1.0
User: nsh
Date: 11/24/2008 11:40 pm
Views: 175
Rating: 15

It seems you still need to work with svn trunk versions. Alternatively I think you can just try to fix this livesegment code.

 

--- (Edited on 11/24/2008 11:40 pm [GMT-0600] by nsh) ---

Re: Voicekey 0.1.0
User: paul
Date: 11/26/2008 5:44 am
Views: 451
Rating: 14

I can remove python-setuptools and get svn version to install of sphinxbase and sphinx3.  But, make install in voicekey still fails on sphinx3_livesegment.c errors.

 

You meantioned that sphinx3_livesegment.c was based on pocket sphinx.  Is it possible you have a version of pocket sphinx installed which enables the build?  Which version of pocket sphinx did you get sphinx3_livesegment.c from?  I'll try installing that too.

 

Unfortunately, I'm not a coder, so can't figure out how to fix sphinx3_livesegment.c.

 

As a last resort, could you post your binaries on your project repository?

 

thanks,

 

Paul

--- (Edited on 11/26/2008 5:44 am [GMT-0600] by Visitor) ---

Re: Voicekey 0.1.0
User: Paul
Date: 12/2/2008 12:53 pm
Views: 155
Rating: 15

I might have a clue.  In your announcement, you said:

 

3) sphinx3_livesegment, which is pocketsphinx_continuous (tty-continuous.c), ported from pocketsphinx to sphinx3, except that it also listens on stdin for a small set of commands which can be used to dynamically switch the language model or change some configuration parameters

 

But, in my downloaded package, the sphinx3_livesegment.c is the same as tty-continuous.c , which is in the parent directory.  Is it possible you put the wrong file in the package?  Please check again.

 

If it was correct, then please provide the binary.  I've tried compiling on another linux, fedora 10, with the same failure as occured on ubuntu.

 

regards,

 

Paul

--- (Edited on 12/2/2008 12:53 pm [GMT-0600] by Visitor) ---

Re: Voicekey 0.1.0
User: nsh
Date: 12/2/2008 4:41 pm
Views: 329
Rating: 14

Sorry, it's not my anouncement, I suggest you to contact author if you need any help on this application. I also tried to compile it for some time, but failed.

--- (Edited on 12/2/2008 4:41 pm [GMT-0600] by nsh) ---

Re: Voicekey 0.1.0
User: paul
Date: 1/7/2009 7:22 am
Views: 761
Rating: 14

As it turns out, I needed to install the python-all-dev package to get all the header files needed to build this.


There's a new version 0.1.1 available, but there have been a lot of improvements since that, so you ought to contact the author for an update if you want to try it.


regards,

 

--- (Edited on 1/7/2009 7:22 am [GMT-0600] by Visitor) ---

Re: Voicekey 0.1.0
User: tscoffee115
Date: 8/18/2009 8:01 pm
Views: 3701
Rating: 9


It so great. Thanks a lots.

 

--- (Edited on 8/18/2009 8:01 pm [GMT-0500] by tscoffee115) ---

--- (Edited on 8/18/2009 9:37 pm [GMT-0400] by tscoffee115) ---

PreviousNext