hi,

i hv created my own dictionary,filler n language model...but after giving the following command i am facing dis problem......

[bharati@sit-dhcp-10-14-88-211 sreekanth]$ perl scripts_pl/00.verify/verify_all.pl
MODULE: 00 verify training files
O.S. is case sensitive ("A" != "a").
Phones will be treated as case sensitive.
    Phase 1: DICT - Checking to see if the dict and filler dict agrees with the phonelist file.
        Found 6960 words using 59 phones
    Phase 2: DICT - Checking to make sure there are not duplicate entries in the dictionary
    Phase 3: CTL - Check general format; utterance length (must be positive); files exist
    Phase 4: CTL - Checking number of lines in the transcript should match lines in control file
    Phase 5: CTL - Determine amount of training data, see if n_tied_states seems reasonable.
        Total Hours Training: 0.00166965811965812
        This is a small amount of data, no comment at this time
    Phase 6: TRANSCRIPT - Checking that all the words in the transcript are in the dictionary
        Words in dictionary: 6957
        Words in filler dictionary: 3
    Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once
WARNING: This phone (SIL) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (a) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (aa) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ai) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (au) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (b) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (bh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ch) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (chh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d:h) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (dh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (dh~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (d~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (e) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (e-) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ei) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (g) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (gh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (g~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (h) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (h:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (i) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ii) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (j) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (jh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (j~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (k) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (kh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (kh~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (k~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (l) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (l:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (m) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (n) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (n:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (nd~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ng~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (nj~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (o) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (o-) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (oo) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (p) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ph) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (ph~) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (r) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (rx) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (s) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (sh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (shh) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (t) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (t:) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (t:h) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (th) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (u) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (uu) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (v) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)

can someone  tell me how to create transcription file???

--- (Edited on 6/8/2010 6:11 am [GMT-0500] by amitkr) ---

> can someone  tell me how to create transcription file???

Find transcription file in etc subfolder of an4 database from tutorial and do the same:

http://cmusphinx.sourceforge.net/html/tutorial.html

--- (Edited on 6/9/2010 12:35 [GMT+0400] by nsh) ---

hi sir,

actually d problem i'm facing is dat whenever i run d following command i get warnings:

[bharati@sit-dhcp-10-14-88-211 sreekanth]$ perl scripts_pl/00.verify/verify_all.pl
MODULE: 00 verify training files
O.S. is case sensitive ("A" != "a").
Phones will be treated as case sensitive.
    Phase 1: DICT - Checking to see if the dict and filler dict agrees with the phonelist file.
        Found 6960 words using 59 phones
    Phase 2: DICT - Checking to make sure there are not duplicate entries in the dictionary
    Phase 3: CTL - Check general format; utterance length (must be positive); files exist
    Phase 4: CTL - Checking number of lines in the transcript should match lines in control file
    Phase 5: CTL - Determine amount of training data, see if n_tied_states seems reasonable.
        Total Hours Training: 0.00166965811965812
        This is a small amount of data, no comment at this time
    Phase 6: TRANSCRIPT - Checking that all the words in the transcript are in the dictionary
        Words in dictionary: 6957
        Words in filler dictionary: 3
    Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once
WARNING: This phone (SIL) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (a) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (aa) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription

though the phone occurs in both phonelist and transcrition file..

plzz suggest how to tackle dis problem????

--- (Edited on 6/9/2010 7:14 am [GMT-0500] by Visitor) ---

hi sir,

actually d problem i'm facing is dat whenever i run d following command i get warnings:

[bharati@sit-dhcp-10-14-88-211 sreekanth]$ perl scripts_pl/00.verify/verify_all.pl
MODULE: 00 verify training files
O.S. is case sensitive ("A" != "a").
Phones will be treated as case sensitive.
    Phase 1: DICT - Checking to see if the dict and filler dict agrees with the phonelist file.
        Found 6960 words using 59 phones
    Phase 2: DICT - Checking to make sure there are not duplicate entries in the dictionary
    Phase 3: CTL - Check general format; utterance length (must be positive); files exist
    Phase 4: CTL - Checking number of lines in the transcript should match lines in control file
    Phase 5: CTL - Determine amount of training data, see if n_tied_states seems reasonable.
        Total Hours Training: 0.00166965811965812
        This is a small amount of data, no comment at this time
    Phase 6: TRANSCRIPT - Checking that all the words in the transcript are in the dictionary
        Words in dictionary: 6957
        Words in filler dictionary: 3
    Phase 7: TRANSCRIPT - Checking that all the phones in the transcript are in the phonelist, and all phones in the phonelist appear at least once
WARNING: This phone (SIL) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (a) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth_train.transcription)
WARNING: This phone (aa) occurs in the phonelist (/home/bharati/Desktop/tutorial/sreekanth/etc/sreekanth.phone), but not in any word in the transcription

though the phone occurs in both phonelist and transcrition file..

plzz suggest how to tackle dis problem????

--- (Edited on 6/9/2010 7:18 am [GMT-0500] by amitkr) ---

> though the phone occurs in both phonelist and transcrition file..

No, it doesn't present in in transcription file and program tells you about that. You need to verify everything carefully once again. Probably you missed the space or violated the format some other way. For missing SIL, it's likely you miss <s> in the start of utterance and </s> in the end. Please try to follow the format carefully.

Also, about your training data size. It's impossible to train with such small amount of data. You need much more.

--- (Edited on 6/9/2010 16:39 [GMT+0400] by nsh) ---

hi sir,

i hv followed the format but den also ,its showing the warnings....n i hv used <s> and </s> in transcript file....but warning for SIl is still there...

plzz suggest how 2 get rid of this warning???

--- (Edited on 6/9/2010 7:53 am [GMT-0500] by amitkr) ---

If you can't find the issue yourself you can always pack all your files in archive and upload to public sharing resource and give us a link. This way you will let us to check your work.

--- (Edited on 6/9/2010 17:06 [GMT+0400] by nsh) ---

hi sir,

I'm sending u all the files ...u plzzz chk n let me know where the problem lies:

here is the link:.....

http://www.adrive.com/public/0f346b43bacebb08856b3025ecc2ad640055cc58b72867c5fb6103ecedccf236.html

--- (Edited on 6/10/2010 6:04 am [GMT-0500] by amitkr) ---

I see extra whitespaces in the end of line after utterance id. Also I see that there are empty lines.

--- (Edited on 6/10/2010 15:40 [GMT+0400] by nsh) ---