File: LowerCaseTokenizer.pm

package info (click to toggle)
libplucene-perl 1.24-1
  • links: PTS
  • area: main
  • in suites: etch, etch-m68k
  • size: 1,292 kB
  • ctags: 429
  • sloc: perl: 4,158; makefile: 52
file content (26 lines) | stat: -rw-r--r-- 421 bytes parent folder | download | duplicates (6) 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
 
package Plucene::Analysis::LowerCaseTokenizer;

=head1 NAME 

Plucene::Analysis::LowerCaseTokenizer - tokenizer which also lower cases text

=head1 SYNOPSIS

	# isa Plucene::Analysis::LetterTokenizer

=head1 DESCRIPTION

This tokenizer divides text at non letters, and also lower cases them.

=head1 METHODS

=cut

use strict;
use warnings;

use base 'Plucene::Analysis::LetterTokenizer';

sub normalize { lc $_[1] }

1;