Plucene::Analysis::LetterTokenizer3pm

Letter tokenizer

Usage

        # isa Plucene::Analysis::CharTokenizer

This is the letter tokenizer class, which divides text at non-letters.

Note: this does a decent job for most European languages, but does a terrible job for some Asian languages, where words are not separated by spaces

11 releases since Debian 3.1 (Sarge); the text changed 5 times.