org.apache.solr.analysis

Class JapaneseTokenizerFactory

java.lang.Object

org.apache.solr.analysis.BaseTokenStreamFactory

org.apache.solr.analysis.BaseTokenizerFactory

org.apache.solr.analysis.JapaneseTokenizerFactory

All Implemented Interfaces:

TokenizerFactory, ResourceLoaderAware

public class JapaneseTokenizerFactory
extends BaseTokenizerFactory
implements ResourceLoaderAware

Factory for JapaneseTokenizer.

 <fieldType name="text_ja" class="solr.TextField">
   <analyzer>
     <tokenizer class="solr.JapaneseTokenizerFactory"
       mode=NORMAL
       userDictionary=user.txt
       userDictionaryEncoding=UTF-8
     />
     <filter class="solr.JapaneseBaseFormFilterFactory"/>
   </analyzer>
 </fieldType>
 

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.lucene.analysis.ja.JapaneseTokenizer.Mode	mode
private static java.lang.String	MODE
private static java.lang.String	USER_DICT_ENCODING
private static java.lang.String	USER_DICT_PATH
private org.apache.lucene.analysis.ja.dict.UserDictionary	userDictionary

Fields inherited from class org.apache.solr.analysis.BaseTokenizerFactory

log

Fields inherited from class org.apache.solr.analysis.BaseTokenStreamFactory

args, luceneMatchVersion

Constructor Summary

Constructors

Constructor and Description
JapaneseTokenizerFactory()

Method Summary

Modifier and Type	Method and Description
org.apache.lucene.analysis.Tokenizer	create(java.io.Reader input) Creates a TokenStream of the specified input
private org.apache.lucene.analysis.ja.JapaneseTokenizer.Mode	getMode(java.util.Map<java.lang.String,java.lang.String> args)
void	inform(ResourceLoader loader)

Methods inherited from class org.apache.solr.analysis.BaseTokenStreamFactory

assureMatchVersion, getArgs, getBoolean, getBoolean, getInt, getInt, getInt, getSnowballWordSet, getWordSet, init, warnDeprecated

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.solr.analysis.TokenizerFactory

getArgs, init

Field Detail

MODE

private static final java.lang.String MODE

See Also:

Constant Field Values

USER_DICT_PATH

private static final java.lang.String USER_DICT_PATH

See Also:

Constant Field Values

USER_DICT_ENCODING

private static final java.lang.String USER_DICT_ENCODING

See Also:

Constant Field Values

userDictionary

private org.apache.lucene.analysis.ja.dict.UserDictionary userDictionary

mode

private org.apache.lucene.analysis.ja.JapaneseTokenizer.Mode mode

Constructor Detail

JapaneseTokenizerFactory

public JapaneseTokenizerFactory()

Method Detail

inform

public void inform(ResourceLoader loader)

Specified by:

inform in interface ResourceLoaderAware

create

public org.apache.lucene.analysis.Tokenizer create(java.io.Reader input)

Description copied from interface: TokenizerFactory

Creates a TokenStream of the specified input

Specified by:

create in interface TokenizerFactory

getMode

private org.apache.lucene.analysis.ja.JapaneseTokenizer.Mode getMode(java.util.Map<java.lang.String,java.lang.String> args)