File: ngramsort.1

package info (click to toggle)
opengrm-ngram 1.3.2-3
  • links: PTS, VCS
  • area: main
  • in suites: buster, sid
  • size: 59,088 kB
  • ctags: 1,161
  • sloc: sh: 13,005; cpp: 8,945; makefile: 286; ansic: 235
file content (105 lines) | stat: -rw-r--r-- 2,941 bytes parent folder | download
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
.\" DO NOT MODIFY THIS FILE!  It was generated by help2man 1.47.4.
.TH NGRAMSORT "1" "August 2017" "OpenGrm NGram library 1.3.2" "User Commands"
.SH NAME
ngramsort \- Sorts an ngram LM in lexicographic state context order.
.SH DESCRIPTION
Sorts an ngram LM in lexicographic state context order.
.IP
.SH SYNOPSIS
ngramsort [\-\-options] [in.fst [out.fst]]
.SH OPTIONS
.PP
.HP
\fB\-\-backoff_label\fR: type = int64, default = 0
.IP
Backoff label
.HP
\fB\-\-check_consistency\fR: type = bool, default = false
.IP
Check model consistency
.HP
\fB\-\-norm_eps\fR: type = double, default = 0.001
.IP
Normalization check epsilon
.PP
.HP
\fB\-\-help\fR: type = bool, default = false
.IP
show usage information
.HP
\fB\-\-helpshort\fR: type = bool, default = false
.IP
show brief usage information
.HP
\fB\-\-tmpdir\fR: type = string, default = "/tmp"
.IP
temporary directory
.HP
\fB\-\-v\fR: type = int32, default = 0
.IP
verbosity level
.PP
.HP
\fB\-\-fst_align\fR: type = bool, default = false
.IP
Write FST data aligned where appropriate
.HP
\fB\-\-fst_default_cache_gc\fR: type = bool, default = true
.IP
Enable garbage collection of cache
.HP
\fB\-\-fst_default_cache_gc_limit\fR: type = int64, default = 1048576
.IP
Cache byte size that triggers garbage collection
.HP
\fB\-\-fst_read_mode\fR: type = string, default = "read"
.IP
Default file reading mode for mappable files
.HP
\fB\-\-fst_verify_properties\fR: type = bool, default = false
.IP
Verify FST properties queried by TestProperties
.HP
\fB\-\-save_relabel_ipairs\fR: type = string, default = ""
.IP
Save input relabel pairs to file
.HP
\fB\-\-save_relabel_opairs\fR: type = string, default = ""
.IP
Save output relabel pairs to file
.PP
.HP
\fB\-\-end_symbol\fR: type = string, default = "</s>"
.IP
Class label for sentence start
.HP
\fB\-\-start_symbol\fR: type = string, default = "<s>"
.IP
Class label for sentence start
.PP
.HP
\fB\-\-fst_compat_symbols\fR: type = bool, default = true
.IP
Require symbol tables to match when appropriate
.HP
\fB\-\-fst_field_separator\fR: type = string, default = "      "
.IP
Set of characters used as a separator between printed fields
.PP
.HP
\fB\-\-fst_error_fatal\fR: type = bool, default = true
.IP
FST errors are fatal; o.w. return objects flagged as bad: e.g., FSTs: kError property set, FST weights: not a Member()
.HP
\fB\-\-ngram_error_fatal\fR: type = bool, default = true
.IP
NGram errors are fatal; o.w. return objects flagged as bad:  e.g., NGramModel::Error() returns true.
.PP
.HP
\fB\-\-fst_weight_parentheses\fR: type = string, default = ""
.IP
Characters enclosing the first weight of a printed composite weight (e.g., pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size 0 (none) or 2 (open and close parenthesis)
.HP
\fB\-\-fst_weight_separator\fR: type = string, default = ","
.IP
Character separator between printed composite weights; must be a single character