Examples of Qrels

edu.gslis.eval.Qrels
ivory.core.eval.Qrels

Representation of relevance judgments. In TREC parlance, qrels are judgments made by humans as to whether a document is relevant to an information need (i.e., topic). Typically, qrels are created by a process known as "pooling" in large-scale system evaluations such as those at TREC.
@author Jimmy Lin

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/gov2/qrels.gov2.all"));
  }

View Full Code Here

Examples of ivory.core.eval.Qrels


      System.err.println("Total query time for heuristic " + heuristic + ":" + (end - start) + "ms");
    }
    ivory.regression.sigir2013.cdec.EnZh_NTCIR8.initialize();
    ivory.regression.sigir2013.cdec.EnZh_NTCIR8.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/" + PATH + "/qrels." + PATH+ ".txt"));


    System.err.println("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Gov2_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/gov2/qrels.gov2.all"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Web09catB_All.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/clue/qrels.web09catB.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Wt10g_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/wt10g/qrels.wt10g.all"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/cacm/qrels.cacm.txt"));
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

Examples of ivory.core.eval.Qrels

    long end = System.currentTimeMillis();


    LOG.info("Total query time: " + (end - start) + "ms");


    Robust04_Basic.verifyAllResults(qr.getModels(), qr.getAllResults(), qr.getDocnoMapping(),
        new Qrels("data/trec/qrels.robust04.noCRFR.txt"));


    LOG.info("Done!");
  }

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.