#include <IndriTokenizer.hpp>
Inheritance diagram for indri::parse::Tokenizer:
Public Member Functions | |
Tokenizer () | |
virtual | ~Tokenizer () |
virtual TokenizedDocument * | tokenize (UnparsedDocument *document)=0 |
virtual void | handle (UnparsedDocument *document)=0 |
virtual void | setHandler (ObjectHandler< TokenizedDocument > &handler)=0 |
|
|
|
|
|
Implements indri::parse::ObjectHandler< UnparsedDocument >. Implemented in indri::parse::TextTokenizer. |
|
Implemented in indri::parse::TextTokenizer. |
|
Implemented in indri::parse::TextTokenizer. |