org.apache.solr.analysis

Class DictionaryCompoundWordTokenFilterFactory

java.lang.Object

org.apache.solr.analysis.BaseTokenStreamFactory

org.apache.solr.analysis.BaseTokenFilterFactory

org.apache.solr.analysis.DictionaryCompoundWordTokenFilterFactory

All Implemented Interfaces:

TokenFilterFactory, ResourceLoaderAware

public class DictionaryCompoundWordTokenFilterFactory
extends BaseTokenFilterFactory
implements ResourceLoaderAware

Factory for DictionaryCompoundWordTokenFilter.

 <fieldType name="text_dictcomp" class="solr.TextField" positionIncrementGap="100">
   <analyzer>
     <tokenizer class="solr.WhitespaceTokenizerFactory"/>
     <filter class="solr.DictionaryCompoundWordTokenFilterFactory" dictionary="dictionary.txt"
             minWordSize="5" minSubwordSize="2" maxSubwordSize="15" onlyLongestMatch="true"/>
   </analyzer>
 </fieldType>

Version:

$Id: DictionaryCompoundWordTokenFilterFactory.java 1073344 2011-02-22 14:35:02Z koji $

Field Summary

Fields

Modifier and Type	Field and Description
private java.lang.String	dictFile
private org.apache.lucene.analysis.CharArraySet	dictionary
private int	maxSubwordSize
private int	minSubwordSize
private int	minWordSize
private boolean	onlyLongestMatch

Fields inherited from class org.apache.solr.analysis.BaseTokenFilterFactory

log

Fields inherited from class org.apache.solr.analysis.BaseTokenStreamFactory

args, luceneMatchVersion

Constructor Summary

Constructors

Constructor and Description
DictionaryCompoundWordTokenFilterFactory()

Method Summary

Modifier and Type	Method and Description
org.apache.lucene.analysis.compound.DictionaryCompoundWordTokenFilter	create(org.apache.lucene.analysis.TokenStream input) Transform the specified input TokenStream
void	inform(ResourceLoader loader)
void	init(java.util.Map<java.lang.String,java.lang.String> args) init will be called just once, immediately after creation.

Methods inherited from class org.apache.solr.analysis.BaseTokenStreamFactory

assureMatchVersion, getArgs, getBoolean, getBoolean, getInt, getInt, getInt, getSnowballWordSet, getWordSet, warnDeprecated

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.solr.analysis.TokenFilterFactory

getArgs

Field Detail

dictionary

private org.apache.lucene.analysis.CharArraySet dictionary

dictFile

private java.lang.String dictFile

minWordSize

private int minWordSize

minSubwordSize

private int minSubwordSize

maxSubwordSize

private int maxSubwordSize

onlyLongestMatch

private boolean onlyLongestMatch

Constructor Detail

DictionaryCompoundWordTokenFilterFactory

public DictionaryCompoundWordTokenFilterFactory()

Method Detail

init

public void init(java.util.Map<java.lang.String,java.lang.String> args)

Description copied from interface: TokenFilterFactory

init will be called just once, immediately after creation.

The args are user-level initialization parameters that may be specified when declaring the factory in the schema.xml

Specified by:

init in interface TokenFilterFactory

Overrides:

init in class BaseTokenStreamFactory

inform

public void inform(ResourceLoader loader)

Specified by:

inform in interface ResourceLoaderAware

create

public org.apache.lucene.analysis.compound.DictionaryCompoundWordTokenFilter create(org.apache.lucene.analysis.TokenStream input)

Description copied from interface: TokenFilterFactory

Transform the specified input TokenStream

Specified by:

create in interface TokenFilterFactory