Package org.apache.lucene.analysis.ja
Class JapaneseKatakanaStemFilter
java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
org.apache.lucene.analysis.ja.JapaneseKatakanaStemFilter
- All Implemented Interfaces:
Closeable,AutoCloseable,Unwrappable<TokenStream>
A
TokenFilter that normalizes common katakana spelling variations ending in a long sound
character by removing this character (U+30FC). Only katakana words longer than a minimum length
are stemmed (default is four).
Note that only full-width katakana characters are supported. Please use a CJKWidthFilter to convert half-width katakana to full-width
before using this filter.
In order to prevent terms from being stemmed, use an instance of SetKeywordMarkerFilter or a custom TokenFilter
that sets the KeywordAttribute before this TokenStream.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
AttributeSource.State -
Field Summary
FieldsFields inherited from class org.apache.lucene.analysis.TokenFilter
inputFields inherited from class org.apache.lucene.analysis.TokenStream
DEFAULT_TOKEN_ATTRIBUTE_FACTORY -
Constructor Summary
Constructors -
Method Summary
Methods inherited from class org.apache.lucene.analysis.TokenFilter
close, end, reset, unwrapMethods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString
-
Field Details
-
DEFAULT_MINIMUM_LENGTH
public static final int DEFAULT_MINIMUM_LENGTH- See Also:
-
-
Constructor Details
-
JapaneseKatakanaStemFilter
-
JapaneseKatakanaStemFilter
-
-
Method Details
-
incrementToken
- Specified by:
incrementTokenin classTokenStream- Throws:
IOException
-