Examples of Qrels

edu.gslis.eval.Qrels
ivory.core.eval.Qrels

Representation of relevance judgments. In TREC parlance, qrels are judgments made by humans as to whether a document is relevant to an information need (i.e., topic). Typically, qrels are created by a process known as "pooling" in large-scale system evaluations such as those at TREC.
@author Jimmy Lin

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Web09catB_All.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/clue/qrels.web09catB.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Gov2_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/gov2/qrels.gov2.all"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Wt10g_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/wt10g/qrels.wt10g.all"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Web09catB_All.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/clue/qrels.web09catB.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels


    qe.init(conf, fs);
    qe.runQueries(conf);


    verifyAllResults(qe.getModels(), qe.getAllResults(), qe.getDocnoMapping(),
        new Qrels("data/en-fr.clef06/qrels.en-fr.clef06.txt"));
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    EnAr_TREC02.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/en-ar.trec02/qrels.en-ar.trec02.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    EnFr_CLEF06.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/en-fr.clef06/qrels.en-fr.clef06.txt"));


    LOG.info("Done!");
  }

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.