File: Tokenizer.rst

package info (click to toggle)
py-stringmatching 0.4.3-1
  • links: PTS, VCS
  • area: main
  • in suites: bookworm
  • size: 1,956 kB
  • sloc: python: 3,979; makefile: 174; sh: 7
file content (13 lines) | stat: -rw-r--r-- 200 bytes parent folder | download | duplicates (2) 
1
2
3
4
5
6
7
8
9
10
11
12
13
 
===================
Tokenizers
===================

.. toctree::
    :maxdepth: 2

    AlphabeticTokenizer
    AlphanumericTokenizer
    DelimiterTokenizer
    QgramTokenizer
    WhitespaceTokenizer