Examples of TagSet

com.amazonaws.services.s3.model.TagSet
com.cedarsoft.utils.tags.TagSet
A tag set contains several tags.
org.eclipse.jst.jsf.validation.internal.constraints.TagSet
A representation of the model object 'Tag Set'.
The following features are supported:
- {@link org.eclipse.jst.jsf.validation.internal.constraints.TagSet#getTags Tags}
@see org.eclipse.jst.jsf.validation.internal.constraints.ConstraintsPackage#getTagSet() @model @generated
org.terrier.utility.TagSet
A class that models a set of tags to process (white list), a set of tags to skip (black list), a tag that is used as a document delimiter, and a tag the contents of which are used as a unique identifier. The text within any tag encountered within the scope of a tag from the white list, is processed by default, unless it is explicitly black listed.
For example, in order to index all the text within the DOC tag of a document from a typical TREC collection, without indexing the contents of the DOCHDR tag, we could define in the properties file the following properties:
TrecDocTags.doctag=DOC
TrecDocTags.idtag=DOCNO
TrecDocTags.process=
TrecDocTags.skip=DOCHDR
TrecDocTags.casesensitive=false

In the source code, we would create an instance of the class as follows:
TagSet TrecIndexToProcess = new TagSet("TrecDocTags");
All the tags are converted to uppercase, in order to check whether they belong to the specified set of tags. @author Vassilis Plachouras, Craig Macdonald

Examples of org.terrier.utility.TagSet

    } catch (UnsupportedEncodingException uee) {
      //logger.warn("Desired encoding ("+charset+") unsupported. Resorting to platform default.", uee);
      this.br = new BufferedReader(new InputStreamReader(docStream));
    }
    this.properties = docProperties;  
    this._tags = new TagSet(TagSet.TREC_DOC_TAGS);
    this._exact = new TagSet(TagSet.TREC_EXACT_DOC_TAGS);
    this._fields = new TagSet(TagSet.FIELD_TAGS);
    this.tokeniser = _tokeniser;
    this.currentTokenStream = Tokeniser.EMPTY_STREAM;
    for(int i=0;i<abstractCount;i++)
    {
      abstracts[i] = new StringBuilder(abstractlengths[i]);

View Full Code Here

Examples of org.terrier.utility.TagSet

   */
  public TaggedDocument(Reader docReader, Map<String, String> docProperties, Tokeniser _tokeniser)
  {
    this.br = docReader;
    properties = docProperties;  
    this._tags = new TagSet(TagSet.TREC_DOC_TAGS);
    this._exact = new TagSet(TagSet.TREC_EXACT_DOC_TAGS);
    this._fields = new TagSet(TagSet.FIELD_TAGS);
    this.tokeniser = _tokeniser;
    this.currentTokenStream = Tokeniser.EMPTY_STREAM;
  }

View Full Code Here

Examples of org.terrier.utility.TagSet

   */
  public TRECFullTokenizer() {
    inTagToProcess = false;
    inTagToSkip = false;
    inDocnoTag = false;
    tagSet = new TagSet(TagSet.TREC_DOC_TAGS);
    exactTagSet = new TagSet(TagSet.TREC_EXACT_DOC_TAGS);
    EOD = false;
    EOF = false;
  }

View Full Code Here

Examples of org.terrier.utility.TagSet

  public TRECFullTokenizer(BufferedReader _br) {
    inTagToProcess = false;
    inTagToSkip = false;
    inDocnoTag = false;
    this.br = _br;
    tagSet = new TagSet(TagSet.TREC_DOC_TAGS);
    exactTagSet = new TagSet(TagSet.TREC_EXACT_DOC_TAGS);
    EOD = false;
    EOF = false;
  }

View Full Code Here

0 1 2

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.