//////////////////////////////////////////////////////////////////////

FZoc[
					       last update: 2003.10.01
//////////////////////////////////////////////////////////////////////

ύX
===========
CSRC2000Nx
 Eo

CSRC2003x[^(2003.07.01)F
 Ejulius-3.3 ̏o͌`ɑΉD
 Ejperl svɂiʏ perl œjD
 Eob`XNvg "EVAL.sh" ǉD

CSRC2003(2003.10.01):
 Ejulius-3.4 ̏o͌`ɑΉ
 EMx̏o͂ɑΉDlƂFA, SErr, FRȂǂZo
   (result_cm.pl)


t@C̓e
=================
ɂ perl KvłD

mkhyp.pl		Julius̔FOFʂ̕𒊏otB^
align.pl		Fʂƕ̃ACgc[
score.pl		ACgʂFȂǂZoc[

EVAL.sh			LNXNvg


 Quick Start
==================

 Julius ̔Fʂ̕Wo͂L^OƁCt@CpӂāC
ȉ̂悤Ɏs邱ƂŔFZoł܂D

	% ./EVAL.sh logfile reffile

Clogfile  Julius ̔Fʂ̕Wo͂L^OCreffile
͐t@CłD

ȉɎs܂Dł͒PF(%Correct)  91.13, PF
x(Word Accuracy)  89.35 ƎZoĂ܂D"1st pass" Ƃ
͑1pX݂̂̏ꍇ̌ʂłD

  % /cdrom/tools/scoring/EVAL.sh log_fast.male male20k.jdpr2_1-dic.ref
  log: /project/shikano-lab24/Work/ri/jnas/t/log_fast.male
  ref: male20k.jdpr2_1-dic.ref
  ----------------------------------------------------------------------------
            Snt      Corr      Acc      Sub      Del      Ins      Err   S.Err
  ----------------------------------------------------------------------------
  final (2pass)
  Sum/Avg   100     91.13    89.35     7.54     1.33     1.77    10.65   55.00
  ----------------------------------------------------------------------------
  1st pass
  Sum/Avg   100     82.94    80.91    13.19     3.87     2.03    19.09   78.00
  ----------------------------------------------------------------------------
  evaluation results saved to "./result.log_fast.male/"

ȂC"EVAL.sh" ͎ۂɂ́Cő̂R̃XNvg (mkhyp.pl,
align.pl,score.pl) NČʂ\vOłD
̋̓IȓeɂẮC̉̕ɂD


𕶃t@C̍
=========================

t@ĆCȉ̂悤ɁCt@CɑΉIDƒPi`ԑfj
𕶃eLXg2sgƂċLq܂D
----------------------------------------------------------------------
nm005-025
+I+39 N+gV+2 +J+58 +m+67 +`[+17 
+j+58 ++62 +\iG++44/6/5 A+A+75 +jZ+19
+R+33 +u+28 +m+67 ޗ+UC[+2 ++58 m+JNz+17
B+B+74
----------------------------------------------------------------------
𕶂̌`ԑfFŗp錾ꃂf̌`ԑfƈv悤ɒӂ
D

t@CƁut@CɑΉIDv̕ϊḰC̃fBNg
XNvg "mkhyp.pl" Œ`܂Dڍׂ͈ȉD


//////////////////////////////////////////////////////////////////////
				
//////////////////////////////////////////////////////////////////////

̗
============

Julius̃OFZo邽߂̗̏ȉɎ܂D
EVAL.sh ł͎ۂɈȉ̎菇ŔFZoĂ܂D
EVAL.sh ̓eĂD

JuliusO
   |
(mkhyp.pl)
   |
   v
t@C(.hyp)	𕶃t@C(.ref)
({PMxj
   |                               |
   --------------+------------------
                 |
             (align.pl)
                 |
                 v                                 
        ACgt@C(*.ali)
                 |
                 +---Mx---
                 |                   |
             (score.pl)        (result_cm.pl)
                 |                   |
                 v                   v
           Wvʂ             CM_Histgram
           *.ali.scr/ ȉ
           


mkhyp.pl
===========

	gp@F
		% nkf -e julius.log | \
		  perl mkhyp.pl \
		  -p {1|2} \
		  > julius.hyp


  Julius̔FʃOCTvIDƂ̔Fʂ̑g𒊏o
t@C(*.hyp)쐬܂D܂mMx΁C
o܂D

  IvV -p łǂ̃pX̉t@C쐬邩w肵܂D



 ӂPF

    "-quiet" "-demo" JuliussɂꍇCWv܂D
    iWvɕKvȒPN-gram`ԑf^O񂪏o͂Ȃ߁j
    FZoۂ͏L̃IvVtɎsĂD


 ӂQF

    t@CIDƐ𕶃t@CID́CΉĂKv
    ܂D{c[ł͓͂ƂJNASf[^x[X肵Ct@C
    ΉJNAS̘bIDƕԍɕϊĂ܂D 

	F
		 t@C			TvID
	  /home/somewhere/nm006020.hs.mfc  ->  nm006-020

    JNASȊO̕]Zbggꍇ́C𕶃t@CIDƑΉ
    悤C{XNvg "bunkai_id" ύXĎgpĂD


align.pl
===========

	    gp@F
		    % align.pl \
		          -u {morpheme|char} \
		          [-c] \
		          -f {kanji|kana} \
		          -r reference_file \
		      julius.hyp \
		      > julius.ali

  t@C(*.ref)Ɖt@C(*.hyp)ɑ΂āCDPgĒP̃A
CgƂ܂Dʂ͕Wo͂ɏo͂܂D

  IvV -u ŒP(`ԑfor)CIvV -f ŕ\L(
 or J^Ji)w肵܂D
  ܂`ԑfPʂŃACgꍇɁCꏈsȂǂ
IvV -c Ŏw肵܂D

  t@C(*.ref)̓IvV -r Ŏw肵܂Dt@C̏
t@C(*.hyp)ƓŁCTvIDƐ𕶁i`ԑf^Otj
1sÂ݂ɕׂ̂łD

  PMxt@CɊ܂܂ꍇC͂̂܂܃ACg
  t@Cɏo͂܂D


score.pl
===========

	    gp@F
		    % score.pl julius.ali

  ACǧʂɁCFWv܂DWvʂ
fBNggACgt@C.scrh̉ɕt@Cɕ
o͂܂D


 }F

    SPKR    bID
    Snt	    Tv
    Corr    Pꐳ(Word %Correct)
    Acc	    Pꐳ(Word Accuracy)
    Sub	    u藦
    Del	    폜藦
    Ins	    }藦
    Err	    藦iL3̌vj
    S.Err   藦


result_cm.pl
===============

  ACgʃt@CɒPMx܂܂ĂꍇC
lƂ False Acceptance, Slot Error, False Rejection Ȃǂ̕]
lo͂܂D


								ȏ
