public class TokenRangeSinkTokenizer extends SinkTokenizer
iter, lst| Constructor and Description |
|---|
TokenRangeSinkTokenizer(int lower,
int upper) |
TokenRangeSinkTokenizer(int initCap,
int lower,
int upper) |
| Modifier and Type | Method and Description |
|---|---|
void |
add(Token t)
Override this method to cache only certain tokens, or new tokens based
on the old tokens.
|
void |
reset()
Reset the internal data structures to the start at the front of the list of tokens.
|
close, getTokens, nextnextpublic TokenRangeSinkTokenizer(int lower,
int upper)
public TokenRangeSinkTokenizer(int initCap,
int lower,
int upper)
public void add(Token t)
SinkTokenizeradd in class SinkTokenizert - The Token to add to the sinkpublic void reset()
throws java.io.IOException
SinkTokenizerSinkTokenizer.next(Token)reset in class SinkTokenizerjava.io.IOExceptionCopyright © 2000-2014 Apache Software Foundation. All Rights Reserved.