File: Tokenizer.rst

package info (click to toggle)
py-stringmatching 0.4.2%2Bgit20201204.6a7fb57-2
  • links: PTS, VCS
  • area: main
  • in suites: bullseye
  • size: 1,632 kB
  • sloc: python: 4,000; makefile: 176
file content (13 lines) | stat: -rw-r--r-- 200 bytes parent folder | download | duplicates (2) 
1
2
3
4
5
6
7
8
9
10
11
12
13
 
===================
Tokenizers
===================

.. toctree::
    :maxdepth: 2

    AlphabeticTokenizer
    AlphanumericTokenizer
    DelimiterTokenizer
    QgramTokenizer
    WhitespaceTokenizer