Package org.alfresco.repo.search.impl.lucene.analysis

Class MLTokenDuplicator

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.alfresco.repo.search.impl.lucene.analysis.MLTokenDuplicator

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class MLTokenDuplicator
extends org.apache.lucene.analysis.TokenStream

Create duplicate tokens for multilingual varients The forms are Tokens: Token - all languages {fr}Token - if a language is specified {fr_CA}Token - if a language and country is specified {fr_CA_Varient}Token - for all three {fr__Varient}Token - for a language varient with no country

Author:

andyh

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.State

Field Summary

Fields inherited from class org.apache.lucene.analysis.TokenStream

DEFAULT_TOKEN_ATTRIBUTE_FACTORY

Constructor Summary

Constructors

Constructor	Description
MLTokenDuplicator(java.util.Locale locale, org.alfresco.repo.search.MLAnalysisMode mlAnalysisMode)
MLTokenDuplicator(org.apache.lucene.analysis.TokenStream source, java.util.Locale locale, java.io.Reader reader, org.alfresco.repo.search.MLAnalysisMode mlAnalysisMode)

Method Summary

Modifier and Type	Method	Description
java.util.Iterator<org.apache.lucene.analysis.tokenattributes.PackedTokenAttributeImpl>	buildIterator(org.apache.lucene.analysis.tokenattributes.PackedTokenAttributeImpl token)
void	close()
void	end()
boolean	incrementToken()
void	reset()

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

MLTokenDuplicator

public MLTokenDuplicator(org.apache.lucene.analysis.TokenStream source,
                         java.util.Locale locale,
                         java.io.Reader reader,
                         org.alfresco.repo.search.MLAnalysisMode mlAnalysisMode)

MLTokenDuplicator

public MLTokenDuplicator(java.util.Locale locale,
                         org.alfresco.repo.search.MLAnalysisMode mlAnalysisMode)

Parameters:

locale -

mlAnalysisMode -

Method Detail

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Overrides:

close in class org.apache.lucene.analysis.TokenStream

Throws:

java.io.IOException

reset

public void reset()
           throws java.io.IOException

Overrides:

reset in class org.apache.lucene.analysis.TokenStream

Throws:

java.io.IOException

end

public void end()
         throws java.io.IOException

Overrides:

end in class org.apache.lucene.analysis.TokenStream

Throws:

java.io.IOException

buildIterator

public java.util.Iterator<org.apache.lucene.analysis.tokenattributes.PackedTokenAttributeImpl> buildIterator(org.apache.lucene.analysis.tokenattributes.PackedTokenAttributeImpl token)

incrementToken

public final boolean incrementToken()
                             throws java.io.IOException

Specified by:

incrementToken in class org.apache.lucene.analysis.TokenStream

Throws:

java.io.IOException