org.apache.lucene.benchmark.byTask.feeds

Class EnwikiDocMaker

java.lang.Object

org.apache.lucene.benchmark.byTask.feeds.BasicDocMaker

org.apache.lucene.benchmark.byTask.feeds.LineDocMaker

org.apache.lucene.benchmark.byTask.feeds.EnwikiDocMaker

All Implemented Interfaces:

DocMaker

public class EnwikiDocMaker
extends LineDocMaker

A LineDocMaker which reads the uncompressed english wikipedia dump. Config properties: keep.image.only.docs=false|true
Plus those available in LineDocMaker

See Also:

LineDocMaker

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	keepImages

Fields inherited from class org.apache.lucene.benchmark.byTask.feeds.BasicDocMaker

BODY_FIELD, BYTES_FIELD, config, DATE_FIELD, forever, ID_FIELD, indexVal, NAME_FIELD, storeVal, termVecVal, TITLE_FIELD

Constructor Summary

Constructors

Constructor and Description
EnwikiDocMaker()

Method Summary

Methods

Modifier and Type	Method and Description
Document	makeDocument() Create the next document.
void	setConfig(Config config) Set the properties

Methods inherited from class org.apache.lucene.benchmark.byTask.feeds.LineDocMaker

getNextDocData, makeDocument, numUniqueTexts, resetInputs

Methods inherited from class org.apache.lucene.benchmark.byTask.feeds.BasicDocMaker

addBytes, addUniqueBytes, collectFiles, getByteCount, getCount, getHtmlParser, numUniqueBytes, printDocStatistics, resetUniqueBytes, setHTMLParser

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

keepImages

protected boolean keepImages

Constructor Detail

EnwikiDocMaker

public EnwikiDocMaker()

Method Detail

setConfig

public void setConfig(Config config)

Description copied from interface: DocMaker

Set the properties

Specified by:

setConfig in interface DocMaker

Overrides:

setConfig in class LineDocMaker

makeDocument

public Document makeDocument()
                      throws Exception

Description copied from interface: DocMaker

Create the next document.

Specified by:

makeDocument in interface DocMaker

Overrides:

makeDocument in class LineDocMaker

Throws:

Exception