KinoSearch::Analysis::Analyzer(3pm)

Usage

    # abstract base class -- you probably want PolyAnalyzer, not this.

Overview

In KinoSearch, an Analyzer is a filter which processes text, transforming it from one form into another. For instance, an analyzer might break up a long text into smaller pieces (Tokenizer), or it might convert text to lowercase (LCNormalizer).

Methods

analyze (EXPERIMENTAL)

    $token_batch = $analyzer->analyze($token_batch);

All Analyzer subclasses provide an "analyze" method. "analyze()" takes a single TokenBatch as input, and it returns a TokenBatch, either the same one (probably transformed in some way), or a new one.

LICENSE, DISCLAIMER, BUGS, etc.

See KinoSearch version 0.165.