lemur::parse::WebParser Class Reference

#include <WebParser.hpp>

Inheritance diagram for lemur::parse::WebParser:

List of all members.

Public Member Functions
	WebParser ()
void	parseFile (const string &filename)
	Parse a file.
void	parseBuffer (char *buf, int len)
	Parse a buffer.
long	fileTell () const
	return the current byte position of the file being parsed
Static Public Attributes
const string	identifier = "web"
Private Member Functions
void	doParse ()
	Actual parsing action flow.
Private Attributes
int	state
	The state of the parser.
Property	begelem
	keep a property for being and end of elements
Property	endelem
LinkedPropertyList	proplist
	list

---

Detailed Description

Parses documents in NIST's Web TREC format. Does case folding for words that are not in the acronym list. Contraction suffixes and possessive suffixes are stripped.

U.S.A., USA's, and USAs are converted to USA. Does not recognize acronyms with numbers.

The DOCHDR is ignored.

Text in <script> tags is ignored. Text in HTML <!-- --> comments is ignored.

---

Constructor & Destructor Documentation

lemur::parse::WebParser::WebParser (   )

---

Member Function Documentation

void lemur::parse::WebParser::doParse (   )  [private]

Actual parsing action flow.

long lemur::parse::WebParser::fileTell (   )  const [virtual]

return the current byte position of the file being parsed Implements lemur::api::Parser.

void lemur::parse::WebParser::parseBuffer (  char *  buf, int  len )  [virtual]

Parse a buffer. Implements lemur::api::Parser.

void lemur::parse::WebParser::parseFile (  const string &  filename  )  [virtual]

Parse a file. Implements lemur::api::Parser.

---

Member Data Documentation

Property lemur::parse::WebParser::begelem [private]

keep a property for being and end of elements

Property lemur::parse::WebParser::endelem [private]

const string lemur::parse::WebParser::identifier = "web" [static]

Reimplemented from lemur::api::Parser.

LinkedPropertyList lemur::parse::WebParser::proplist [private]

list

int lemur::parse::WebParser::state [private]

The state of the parser.

---

The documentation for this class was generated from the following files:

• WebParser.hpp
• TextHandlerManager.cpp

---