Package org.apache.lucene.analysis.wikipedia

Tokenizer that is aware of Wikipedia syntax.

See: Description

Class Summary

Class	Description
WikipediaTokenizer	Extension of StandardTokenizer that is aware of Wikipedia syntax.
WikipediaTokenizerFactory	Factory for WikipediaTokenizer.
WikipediaTokenizerImpl	JFlex-generated tokenizer that is aware of Wikipedia syntax.

Package org.apache.lucene.analysis.wikipedia Description

Tokenizer that is aware of Wikipedia syntax.