File: evaluation.gsoc17

package info (click to toggle)
apertium-srd-ita 0.9.5~r82237-2
  • links: PTS, VCS
  • area: main
  • in suites: bullseye, buster, sid
  • size: 3,800 kB
  • sloc: xml: 481; makefile: 118; sh: 24
file content (30 lines) | stat: -rw-r--r-- 1,217 bytes parent folder | download
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30

gianfranco@gianfranco-HP-Notebook:~/Scrivania/Codi/apertium-srd-ita$ ./apertium-eval-translator.pl -test kyuss170401.ita.ini.txt -ref kyuss170401.ita.fin.txt
Test file: 'kyuss170401.ita.ini.txt'
Reference file 'kyuss170401.ita.fin.txt'

Statistics about input files
-------------------------------------------------------
Number of words in reference: 288
Number of words in test: 280
Number of unknown words (marked with a star) in test: 91
Percentage of unknown words: 32.50 %

Results when removing unknown-word marks (stars)
-------------------------------------------------------
Edit distance: 92
Word error rate (WER): 31.94 %
Number of position-independent correct words: 206
Position-independent word error rate (PER): 28.47 %

Results when unknown-word marks (stars) are not removed
-------------------------------------------------------
Edit distance: 160
Word Error Rate (WER): 55.56 %
Number of position-independent correct words: 138
Position-independent word error rate (PER): 52.08 %

Statistics about the translation of unknown words
-------------------------------------------------------
Number of unknown words which were free rides: 68
Percentage of unknown words that were free rides: 74.73 %