1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
|
*******************
Package description
*******************
Package ``hfst`` contains python bindings for `HFST <https://hfst.github.io>`_
(Helsinki Finite-State Technology) C++ library. HFST toolkit is intended for
processing natural language morphologies. The toolkit is demonstrated by
wide-coverage implementations of a number of languages of varying
morphological complexity.
Requirements
############
We offer binary wheels on PyPI for Linux, Mac OS X and Windows.
Wheels for Linux are compiled with a 64-bit docker image (quay.io/pypa/manylinux1_x86_64)
for python versions 2.7, 3.4, 3.5, 3.6 and 3.7.
It is also possible to install hfst to Linux using Debian binary packages (see below).
Wheels for Mac are compiled as universal binaries for python versions 2.7, 3.5, 3.6 and 3.7.
OS X must be 10.7 or higher.
Wheels for Windows are 32-bit and also require a 32-bit python to work correctly.
They are available for python versions 3.5 and 3.6; earlier versions would need
an older compiler that does not support C++11 features.
Wheels for version 3.7. may be added to future releases.
Compiling hfst from source requires at least C++ compiler (tested with gcc 5.4.0),
readline and getline libraries and setuptools package for python
(tested with version 28.8.0). Swig is no longer needed as pre-generated files are
included in source distribution.
Support for python version 2 is experimental and may be left out at some point.
We recommend python version 3 as it works better with unicode.
Installation via PyPI
#####################
We recommend using ``pip`` tool for installation.
Before installation, see that dependencies given under heading 'Requirements' are met.
For python version 3, the ``pip`` tool is usually named ``pip3``, plain ``pip`` being used
for python version 2. Basic installation is done with:
``pip3 install [--upgrade] hfst``
``pip install [--upgrade] hfst``
Starting from python 3.4.0 and 2.7.9, pip is included by default
and can be called via python with option ``-m pip``:
``python3 -m pip install [--upgrade] hfst``
``python -m pip install [--upgrade] hfst``
The commands above are run in a shell/terminal/command prompt, but they can
also be run on python command line or via a graphical user interface
(e.g. IDLE) with ``pip.main`` that takes arguments in a list:
| ``import pip``
| ``pip.main(['install','--upgrade','hfst'])``
The option ``--upgrade`` makes sure that the newest version of hfst will be installed
replacing any earlier versions installed. The option ``--verbose``
will show what happens during the installation process. This can be useful when compiling from source.
Installation for Linux using Debian packages
############################################
Fetch newest Debian release (named ``python3-libhfst`` for python version 3 and ``python-libhfst`` for python version 2)
from `Apertium <http://apertium.projectjj.com/apt/nightly/pool/main/h/hfst/>`_ and install it with
``dpkg --install python[3]-libhfst_***.deb``
When choosing the right package, the command ``lsb_release -a`` might be helpful.
It will e.g. print something like
| ``No LSB modules are available.``
| ``Distributor ID: Ubuntu``
| ``Description: Ubuntu 16.04.2 LTS``
| ``Release: 16.04``
| ``Codename: xenial``
In the example case, the line Codename shows that the right package is of form ``*~xenial1_*.deb``.
The command ``file /usr/bin/file`` is one way to check whether your system is 64-bit or 32-bit. It will print something like:
``/usr/bin/file: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked ...``
In the case above, a package ending in ``amd64.deb`` is the right choice.
Compiling from scratch
######################
It is also possible to compile HFST C++ library and the python bindings from scratch.
Clone or download our `Github repository <https://github.com/hfst/hfst>`_ and
see `README <https://github.com/hfst/hfst/tree/master/python>`_ of the ``python`` subdirectory.
Documentation
#############
See wiki-based `package documentation <https://github.com/hfst/python/wiki>`_
on our Github pages. In python, you can also use ``dir`` and ``help``
commands, e.g.:
``dir(hfst)``
``help(hfst.HfstTransducer)``
License
#######
HFST is licensed under Gnu GPL version 3.0.
Troubleshooting
###############
(In the commands below, ``python[3]`` means either ``python`` or ``python3`` depending of the version of python you are using;
the same goes for ``pip[3]`` meaning ``pip`` or ``pip3``.)
*Pip starts to compile from source although there is a wheel available:*
Try upgrading pip with
``pip[3] install --upgrade pip``
or
``python[3] -m pip install --upgrade pip``.
Another reason for this can be that
the source package on PyPI is newer (i.e. has a higher version number) than
the corresponding wheel for the given environment. Report this via our
`issue tracker <https://github.com/hfst/hfst/issues/>`_ so a fresh wheel
will be created.
*Error message "command ... failed with error code ...":*
Try rerunning pip in verbose mode with
``pip[3] install --verbose [--upgrade] hfst``
or
``python[3] -m pip install --verbose [--upgrade] hfst``
to get more information.
*Error message "error: could not delete ... : permission denied":*
You do not have sufficient rights to install packages. On Mac and Linux, try
installing as super user with
``sudo pip[3] install [--upgrade] hfst``
or
``sudo python[3] -m pip install [--upgrade] hfst``.
On Windows, reopen Command Prompt/Python command line/IDLE by right-clicking
and choose "Run as administrator", then run pip again.
Links
#####
`HFST project main page <https://hfst.github.io>`_: more information about
the project
`Github issue tracker <https://github.com/hfst/hfst/issues/>`_: for comments,
feature requests and bug reports
|
