org.apache.lucene.analysis.fr

Class ElisionFilter

java.lang.Object

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.TokenFilter

org.apache.lucene.analysis.fr.ElisionFilter

public class ElisionFilter
extends TokenFilter

Removes elisions from a token stream. For example, "l'avion" (the plane) will be tokenized as "avion" (plane).

Note that StandardTokenizer sees " ' " as a space, and cuts it out.

See Also:

Elision in Wikipedia

Field Summary

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	ElisionFilter(TokenStream input) Constructs an elision filter with standard stop words
	ElisionFilter(TokenStream input, Set articles) Constructs an elision filter with a Set of stop words
	ElisionFilter(TokenStream input, String[] articles) Constructs an elision filter with an array of stop words

Method Summary

Methods

Modifier and Type	Method and Description
Token	next(Token reusableToken) Returns the next input Token with term() without elisioned start
void	setArticles(Set articles)

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close, reset

Methods inherited from class org.apache.lucene.analysis.TokenStream

next

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ElisionFilter

protected ElisionFilter(TokenStream input)

Constructs an elision filter with standard stop words

ElisionFilter

public ElisionFilter(TokenStream input,
             Set articles)

Constructs an elision filter with a Set of stop words

ElisionFilter

public ElisionFilter(TokenStream input,
             String[] articles)

Constructs an elision filter with an array of stop words

Method Detail

setArticles

public void setArticles(Set articles)

next

public Token next(Token reusableToken)
           throws IOException

Returns the next input Token with term() without elisioned start

Overrides:

next in class TokenStream

Throws:

IOException