Plucene::Analysis::WhitespaceTokenizer (3pm)

White space tokenizer

  1. Carta.tech
  2. Man Pages
  3. MISSING SECTION
  4. Plucene::Analysis::WhitespaceTokenizer: White space tokenizer
  1. Carta.tech
  2. Packages
  3. libplucene-perl
  4. Plucene::Analysis::WhitespaceTokenizer: White space tokenizer

SYNOPSIS

        # isa Plucene::Analysis::CharTokenizer

DESCRIPTION

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

METHODS