Table 2 Kappa results. Kappa results for inter-judge agreement in relevant judgments for ad hoc retrieval task.
From: Enhancing access to the Bibliome: the TREC 2004 Genomics Track
Judge 2 | Definitely relevant | Possibly relevant | Not relevant | Total |
|---|---|---|---|---|
Judge 1 | Â | Â | Â | Â |
Definitely relevant | 62 | 35 | 8 | 105 |
Possibly relevant | 11 | 11 | 5 | 27 |
Not relevant | 14 | 57 | 456 | 527 |
Total | 87 | 103 | 469 | 659 |