Acoustic Model Discussions

Flat
error in verify_all.pl
User: amitkr
Date: 6/8/2010 6:11 am
Views: 7199
Rating: 1

hi,

i hv created my own dictionary,filler n language model...but after giving the following command i am facing dis problem......

[bharati@sit-dhcp-10-14-88-211 sreekanth]$ perl scripts_pl/00.verify/verify_all.pl
MODULE: 00 verify training files
O.S. is case sensitive ("A" != "a").
Phones will be treated as case sensitive.
    Phase 1: DICT - Checking to see if the dict and filler dict agrees with the phonelist file.
        Found 6960 words using 59 phones
    Phase 2: DICT - Checking to make sure there are not duplicate entries in the dictionary
    Phase 3: CTL - Check general format; utterance length (must be positive); files exist
    Phase 4: CTL - Checking number of lines in the transcript should match lines in control file
    Phase 5: CTL - Determine amount of training data, see if n_tied_states seems reasonable.
        Total Hours Training: 0.00166965811965812
        This is a small amount of data, no comment at this time
    Phase 6: TRANSCRIPT - Checking that all the words in the transcript are in the dictionary
        Words in dictionary: 6957
        Words in filler dictionary: 3
    Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once
WARNING: This phone (SIL) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (a) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (aa) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ai) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (au) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (b) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (bh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ch) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (chh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d:h) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (dh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (dh~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (e) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (e-) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ei) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (g) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (gh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (g~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (h) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (h:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (i) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ii) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (j) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (jh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (j~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (k) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (kh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (kh~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (k~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (l) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (l:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (m) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (n) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (n:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (nd~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ng~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (nj~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (o) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (o-) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (oo) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (p) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ph) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ph~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (r) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (rx) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (s) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (sh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (shh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (t) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (t:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (t:h) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (th) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (u) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (uu) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (v) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)

can someone  tell me how to create transcription file???

--- (Edited on 6/8/2010 6:11 am [GMT-0500] by amitkr) ---

Re: error in verify_all.pl
User: nsh
Date: 6/9/2010 3:35 am
Views: 72
Rating: 1

> can someone  tell me how to create transcription file???


Find transcription file in etc subfolder of an4 database from tutorial and do the same:

http://cmusphinx.sourceforge.net/html/tutorial.html

--- (Edited on 6/9/2010 12:35 [GMT+0400] by nsh) ---

Re: error in verify_all.pl
User: Visitor
Date: 6/9/2010 7:14 am
Views: 116
Rating: 2

hi sir,

actually d problem i'm facing is dat whenever i run d following command i get warnings:

 

[bharati@sit-dhcp-10-14-88-211 sreekanth]$ perl scripts_pl/00.verify/verify_all.pl
MODULE: 00 verify training files
O.S. is case sensitive ("A" != "a").
Phones will be treated as case sensitive.
    Phase 1: DICT - Checking to see if the dict and filler dict agrees with the phonelist file.
        Found 6960 words using 59 phones
    Phase 2: DICT - Checking to make sure there are not duplicate entries in the dictionary
    Phase 3: CTL - Check general format; utterance length (must be positive); files exist
    Phase 4: CTL - Checking number of lines in the transcript should match lines in control file
    Phase 5: CTL - Determine amount of training data, see if n_tied_states seems reasonable.
        Total Hours Training: 0.00166965811965812
        This is a small amount of data, no comment at this time
    Phase 6: TRANSCRIPT - Checking that all the words in the transcript are in the dictionary
        Words in dictionary: 6957
        Words in filler dictionary: 3
    Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once
WARNING: This phone (SIL) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (a) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (aa) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription

though the phone occurs in both phonelist and transcrition file..

plzz suggest how to tackle dis problem????

--- (Edited on 6/9/2010 7:14 am [GMT-0500] by Visitor) ---

Re: error in verify_all.pl
User: amitkr
Date: 6/9/2010 7:18 am
Views: 102
Rating: 1

hi sir,

actually d problem i'm facing is dat whenever i run d following command i get warnings:

 

[bharati@sit-dhcp-10-14-88-211 sreekanth]$ perl scripts_pl/00.verify/verify_all.pl
MODULE: 00 verify training files
O.S. is case sensitive ("A" != "a").
Phones will be treated as case sensitive.
    Phase 1: DICT - Checking to see if the dict and filler dict agrees with the phonelist file.
        Found 6960 words using 59 phones
    Phase 2: DICT - Checking to make sure there are not duplicate entries in the dictionary
    Phase 3: CTL - Check general format; utterance length (must be positive); files exist
    Phase 4: CTL - Checking number of lines in the transcript should match lines in control file
    Phase 5: CTL - Determine amount of training data, see if n_tied_states seems reasonable.
        Total Hours Training: 0.00166965811965812
        This is a small amount of data, no comment at this time
    Phase 6: TRANSCRIPT - Checking that all the words in the transcript are in the dictionary
        Words in dictionary: 6957
        Words in filler dictionary: 3
    Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once
WARNING: This phone (SIL) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (a) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (aa) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription

though the phone occurs in both phonelist and transcrition file..

plzz suggest how to tackle dis problem????

--- (Edited on 6/9/2010 7:18 am [GMT-0500] by amitkr) ---

Re: error in verify_all.pl
User: nsh
Date: 6/9/2010 7:39 am
Views: 100
Rating: 1

> though the phone occurs in both phonelist and transcrition file..

No, it doesn't present in in transcription file and program tells you about that. You need to verify everything carefully once again. Probably you missed the space or violated the format some other way. For missing SIL, it's likely you miss <s> in the start of utterance and </s> in the end. Please try to follow the format carefully.

Also, about your training data size. It's impossible to train with such small amount of data. You need much more.

 

--- (Edited on 6/9/2010 16:39 [GMT+0400] by nsh) ---

Re: error in verify_all.pl
User: amitkr
Date: 6/9/2010 7:53 am
Views: 77
Rating: 2

hi sir,

i hv followed the format but den also ,its showing the warnings....n i hv used <s> and </s> in transcript file....but warning for SIl is still there...

plzz suggest how 2 get rid of this warning???

--- (Edited on 6/9/2010 7:53 am [GMT-0500] by amitkr) ---

Re: error in verify_all.pl
User: nsh
Date: 6/9/2010 8:06 am
Views: 111
Rating: 1

If you can't find the issue yourself you can always pack all your files in archive and upload to public sharing resource and give us a link. This way you will let us to check your work.

 

--- (Edited on 6/9/2010 17:06 [GMT+0400] by nsh) ---

Re: error in verify_all.pl
User: amitkr
Date: 6/10/2010 6:04 am
Views: 114
Rating: 3

hi sir,

I'm sending u all the files ...u plzzz chk n let me know where the problem lies:

here is the link:.....

http://www.adrive.com/public/0f346b43bacebb08856b3025ecc2ad640055cc58b72867c5fb6103ecedccf236.html

 

 

--- (Edited on 6/10/2010 6:04 am [GMT-0500] by amitkr) ---

Re: error in verify_all.pl
User: nsh
Date: 6/10/2010 6:40 am
Views: 74
Rating: 2

I see extra whitespaces in the end of line after utterance id. Also I see that there are empty lines.

--- (Edited on 6/10/2010 15:40 [GMT+0400] by nsh) ---

Re: error in verify_all.pl
User: amitkr
Date: 6/10/2010 8:08 am
Views: 3333
Rating: 2

hi sir,

I'm unable 2 understand about which file u r speaking....plzz say something specifically.It will be very helpful if u name the file of which u r talking.plzz sir help me in this.....

--- (Edited on 6/10/2010 8:08 am [GMT-0500] by amitkr) ---

PreviousNext