org.alfresco.repo.search.impl.lucene.analysis

Class MLTokenDuplicator

java.lang.Object

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.Tokenizer

org.alfresco.repo.search.impl.lucene.analysis.MLTokenDuplicator

public class MLTokenDuplicator
extends org.apache.lucene.analysis.Tokenizer

Create duplicate tokens for multilingual varients The forms are Tokens: Token - all languages {fr}Token - if a language is specified {fr_CA}Token - if a language and country is specified {fr_CA_Varient}Token - for all three {fr__Varient}Token - for a language varient with no country

Author:

andyh

Field Summary

Fields inherited from class org.apache.lucene.analysis.Tokenizer

input

Constructor Summary

Constructors

Constructor and Description
MLTokenDuplicator(Locale locale, org.alfresco.repo.search.MLAnalysisMode mlAnalaysisMode)
MLTokenDuplicator(org.apache.lucene.analysis.TokenStream source, Locale locale, Reader reader, org.alfresco.repo.search.MLAnalysisMode mlAnalaysisMode)

Method Summary

Modifier and Type	Method and Description
Iterator<org.apache.lucene.analysis.Token>	buildIterator(org.apache.lucene.analysis.Token token)
org.apache.lucene.analysis.Token	next()

Methods inherited from class org.apache.lucene.analysis.Tokenizer

close, reset

Methods inherited from class org.apache.lucene.analysis.TokenStream

next, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MLTokenDuplicator

public MLTokenDuplicator(org.apache.lucene.analysis.TokenStream source,
                         Locale locale,
                         Reader reader,
                         org.alfresco.repo.search.MLAnalysisMode mlAnalaysisMode)

MLTokenDuplicator

public MLTokenDuplicator(Locale locale,
                         org.alfresco.repo.search.MLAnalysisMode mlAnalaysisMode)

Method Detail

next

public org.apache.lucene.analysis.Token next()
                                      throws IOException

Overrides:

next in class org.apache.lucene.analysis.TokenStream

Throws:

IOException

buildIterator

public Iterator<org.apache.lucene.analysis.Token> buildIterator(org.apache.lucene.analysis.Token token)